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ABSTRACT : Most  studies  of  land  warfare  rely  on  the  belief  that  units 

lose  tli^ir  combat  effectiveness,  and  are  unable  to  perform  their  assigned 
mission,  when  a fixed  percentage  of  their  men  are  lost.  This  belief  is 
widely  held  by  experienced  combat  conmanders,  but  is  not  supported  by 
historical  data.  Military  units  are  assemblages  of  equipment  and 
personnel  which  act  in  accordance  with  rehearsed  procedures  to  achieve 
a combat  capability.  Accordingly,  it  seems  more  meaningful  to  analyze 
units  microscopically  to  determine  the  effect  of  personnel  and  materiel 
losses  on  the  subfunctions  the  unit  must  perform  in  combat,  then  to 
aggregate  from  this  base  as  required  by  the  study  being  performed.  In 
this  paper  a method  is  developed,  and  exemplified  for  a 155nin  self- 
propelled  howitzer  battery,  to  relate  the  firing,  ammunition  supply, 
conmand  and  control,  communications,  and  supply  and  maintenance  functions 
to  the  personnel  and  equipment  responsible  for  functional  performance. 

The  mathematical  model  developed  is  used  to  examine  the  results  of 
hostile  counterbattery  fire  so  as  to  determine  the  "weak  links"  in 
unit  survivability,  and  to  test  the  fixed  percentage  loss  theory. 


A SURVIVABILITY  METHODOLOGY  FOR  THE 
ANALYSIS  OF  THEATER  NUCLEAR-CAPABLE  UNITS 

LTC  JOHN  L.  HESSE 

USA  TRADOC  Systems  Analysis  Activity 


1.  Introduction:  As  a result  of  the  recent  Warsaw  Pact  conventional 
force  buildup  in  Central  Europe,  and  an  essentially  unchanged  NATO 
defense  posture,  a greater  implicit  reliance  on  tactical  nuclear  forces 
(TNF)  has  emerged  as  de  facto  NATO  policy.’  The  TNF  role  is  twofold: 
they  reinforce  the  credibility  of  the  NATO  deterrent,  and  they  provide 
a supplement  to  the  conventional  defense  of  Western  Europe.^  In  order 
for  the  TNF  to  fill  these  roles  successfully,  they  must  be  perceived 

by  potential  adversaries  as  able  to  survive  whatever  conflict  environ- 
ment precedes  political  release  of  nuclear  weapons.  Survivability, 
the  degree  to  which  a unit  can  remain  combat  capable  while  withstanding 
hostile  actions,  is  a relatively  new  measure  of  combat  results.  It  can 
be  thought  of  in  terms  of  a SEE-HIT-KILL-REPAIR  cycle,  which  says  that 
if  a unit  can  be  seen  by  enemy  target  acquisition  means,  it  can  be  hit 
by  counterbattery  fires.  Given  sufficient  fire  volume,  unit  elements 
can  be  killed,  thus  degrading  the  unit's  combat  capability.  Restoration 
of  full  capability  requires  renair.  The  extent  to  which  combat  capability 
survives  is  a vital  data  point  in  the  conduct  of  force-on-force  analyses. 

The  purpose  of  this  paper  is  to  suggest  a methodology  for  relating  vulner- 
ability data  to  combat  capability  degradation,  and  hence  to  surviving  unit 
contbat  power  following  an  attack. 

2.  Existing  Methodology:  Most  studies  of  land  warfare  rely  on  the  belief 
that  units  lose  their  combat  effectiveness,  and  are  unable  to  perform  their 
assigned  mission,  when  a fixed  percentage  of  their  men  are  lost.  This 
belief  is  widely  held  by  experienced  combat  commanders,  but  is  not  supported 
by  historical  data.'  Military  units  are  assemblages  of  equipment  and 
personnel  which  act  in  accordance  with  rehearsed  procedures  to  achieve 

a combat  capability.  Accordingly,  it  seems  more  meaningful  to  analyze 
units  microscopically  to  determine  the  effect  of  personnel  and  materiel 
losses  on  the  subfunctions  the  unit  must  perform  in  combat,  then  to 
aggregate  from  this  base  as  required  by  the  studv  being  performed.  This 
forms  the  thrust  of  the  approach  described  here. 

3.  Proposed  Methodology:  From  the  viewpoint  of  a hostile  planner,  four 
target  configurations  are  of  analysis  interest  in  planning  an  attack  on 
a nuclear-capable  unit.  These  are  the  garrison,  or  peacetime,  posture; 
the  dispersal  area  posture;  the  road  march  posture;  and  the  combat  deploy- 
ment posture.  Each  requires  allocation  of  different  delivery  means  and 
amounts  of  ordnance  to  produce  the  desired  effect.  Doctrinally,  Soviet 
forces  employ  two  damage  criteria;  neutralization,  which  implies  20-25 
percent  fractional  damages  to  men  and  materiel,  and  annihilation,  which 
inplies  50-60  percent  losses  to  men  and  materiel."  The  discussion  which 
follows  uses  a combat-deployed  155nii"  howitzer  battery,  as  shown  in  Figure  1, 


to  illustrate  how  losses  in  personnel  and  equipment  degrade  firing 
capability.^  A functional  description  of  the  battery,  in  fault  ti-ee 
fonii,  is  shown  in  Figure  2.  Each  functional  capability  is  related 
to  the  survivability  of  personnel  and  equipment  below. 

a.  Howitzer  Section  Capability.  Four  postulates  follow; 

(1)  Cross-training  of  personnel  within  all  howitzer  sections  is 
complete.  This  has  the  effect  of  making  surviving  personnel  inter- 
changeable, 

(2)  Four-man  crews,  per  howitzer,  will  allow  undegraded  firing 
capability.  Linear  degradation  is  then  assumed  as  the  ct'ew  is  attrited, 
with  a minimum  crew  of  two  men  allowed. 

(3)  In  order  to  sustain  a crew  of  "n"  members,  2n  personnel  are 
required  to  allow  for  alternating  shifts.  Personnel  not  firing, 
however,  are  assumed  available  for  cargo  carrier  duty. 

(4)  Missions  of  sufficient  duration  will  be  assigned  such  that 
ammunition  resupply  will  be  required. 

Noting  that  a pool  of  48  men  exist  in  the  howitzer  sections  together  with 
six  howitzer  and  six  cargo  carriers,  lot: 

Sp  = number  of  surviving  personnel /48 

= number  of  surviving  cargo  carriers/6 

= number  of  surviving  guns/6 

S„,  = min  (Sg,  S^) 

The  definition  of  S implies  that  howitzers  and  cargo  carriers  lost  will 
m 

degrade  unit  capability  equally. 

If  Fo  = undegraded  firing  rate,  and  F = degraded  firing  i-ate: 


F = FoS  if  S„  V S„ 
m m - p 


p = p rJ-L^  I ■»  P.:j.  I + 1 I 

^ I-  6 ‘l  6 ‘2  6 T-* 


If  S > S 
m p 
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who  re ; 


I-  - l'(T  [(48Sp)/8] 

= INT  [(48Sp  - 81^/6] 


I3  = INT  [(48Sj^  - 81^  - 6l2)/4] 

The  integer  function  truncates  the  decimal  portion  of  Ii,  I2.  and  I3. 

Il  represents  the  number  of  4 man  2 shift  crews  which  can  he  foniied 
from  survivinn  interchangeable  personnel.  Ip  gives  the  number  of  3 man 
2 shift  crews  which  can  be  fonned  after  all  4 man  2 shift  crews  are 
formed.  1 3 yields  the  number  of  2 man  2 shift  crews  formed  after  all 
4 man  and  3 man,  2 shift,  crews  are  formed.  The  relative  effectiveness 
of  each  size  crew,  as  detennined  by  equation  2,  is  as  follows: 


Crew  Size 


Relative  Effectiveness 


4 man 
3 man 
2 nnn 


1.0 

0.5 

0.25 


XO  Post  Capability.  The  function  of  this  element  of  the  firing 
batterv  ’s  to  relay  commands  to  the  gun.  We  postulate  here  that  this 
function  can  be  performed  by  many  members  of  the  battery,  and  that  its 
loss  will  not  significantly  degrade  Fo- 


c.  Ammo  Supply  Canability.  Howitzer  battery  ammo  supply  personnel  are 
required  to  load  projectiles  and  propelling  charges  onto  their  own  vehicles 
as  ASPs  and  SASPs.  We  postulate  that  survivability  of  both  8 ton  trucks 
and  ammo  section  personnel  is  linearly  related  to  maximum  firing  rate, 
but  limit  the  effect  to  the  case  where  reduced  anno  supply  effects  exceed 
the  effect  of  I'educed  howitzer  section  capability.  Thus  let: 


and 


8 


r . /Surv  8 ton  trucks,  surv  ammo  handlers m 
[mm  ( •, F“ )J 


Then  ifA-B_0,  r = F<,xA 
A - B 0,  F = Fo  X B 


(3) 

(41 


’Maintenance  and  Supply  Capability.  These  functions,  although  vital 
over  prolonged  periods  of  combat,  are  difficult  to  relate  directly  to  F.  . 

It  may  be  reasonable  to  suggest  that,  for  operational  periods  up  to  two 


nl3 


weeks  in  duration,  a naximuin  of  20“'  denradation  in  Fn  could  occur  as  a 
linear  function  of  survivino  personnel  assumed  interchanqeahle.  Loss 
of  ve^iicular  capability  could  _prohahly  be  made  up  for  by  using  other 
unit  vehicles  for  resupply.  F is  then  represented  by: 


F = [Fquation  (^)]  x [.2  ( 


maintenance  + supply  survivors^  +08]  (b) 

9 


e.  Communications  L Ctwimand_and_  Control  Degradation  (C  J . C functions 
are  concentrated  in  the  ROC,  FDC,  and  communications  sections.  Internal 
wire  nets  are  believed  replaceable  by  voice  or  messenger,  and  will  thus  not 
affect  Fo-  In  the  BOC/FDC,  it  is  postulated  that  9 of  the  12  total  members 
are  interchangeable  in  terms  of  performino  C3  functions.  Of  these,  3 at 
a time  are  required  for  full  capability.  Degradation  will  lie  nonlinear 
based  on  discussions  with  experienced  battery  officers,  and  is  postulated 
to  occur  as  fol lows  : 


F = [Fquation  6]  x 


1.0,  3 FDC/ROC  survivors 
0.85,  2 FDC/ROC  survivors 
0.35,  1 FDC/ROC  survivors 
0,  n FDC/ROC  survivors 


(6) 


This  inhrrently  ionores  the  residual  caoability  to  respond  to  forward 
observer-directed  missions,  and  considers  only  computed  missions. 


f.  Communications  Section.  Coninuni cat i ons  with  the  supported  unit, 
higher,  and  adjacent  units  depends  on  survival  of  the  following; 

(1)  One  of  two  AN/VRC-‘i6/TSEC/KY-38. 

(2)  A source  of  power  (*^577,  Gamma  Gnat,  or  either  battery  generator 
set ) . 

(3)  An  operator. 

(4)  Code  changer  key  KYK-28/TSFC. 

(5)  One  of  two  RC-292  antennas. 


Operator  sHlls  are  sufficiently  widespread  within  the  battery  that  F 
should  not  be  affected.  The  code  chancer  key  will  be  considered  survivable. 


F then  becomes 


F - [ [qua t ion  6]  x 


1,  radio  power  antenna 
0,  anv  other  combination 


17) 


4,  Inherent  i'_vaJj_‘ibiJ_iXv ; The  preceding  paragraphs  treat  combat  damage. 
In  force-on- force  calculations,  the  true  value  of  firing  rate  will  also 
be  affected  bv  availability  of  battery  equipment.  Typical  values  for  the 
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European  theater,  derived  from  records  at  the  USA  Maintenance  Management 
Center,  are  as  follows  for  major  i terns 


Howitzer,  M109  0.67 
Cargo  Carrier,  M548  0.41 
Truck,  8 ton  0.93 


These  values  would  enter  eouations  1,  2,  3,  and  4 as  multipliers  of  the 
equipment  terms. 


5.  An  Example: 

a.  The  155nrt  howitzer  battery  shown  in  Figure  1 was  targeted,  in 
counterbattery  mode,  by  a 122nin  multiple  rocket  launcher  battery. 

Target  acquisition  error  was  parametrically  varied  from  zero  to  800 
meters.  The  resultant  residual  combat  capability,  computed  using  the 
foregoing  methodology,  is  shown  in  Figure  3 as  a function  of  the  number 
of  122nn  rockets  fired  at  it.  Given  that  a battery  volley  equals  240 
rounds,  and  that  the  122mm  multiple  rocket  launcher  battery  has  a 10 
minute  reload  time  between  volleys,®  we  see  the  following; 


(1)  In  the  worst  case  situation  where  hostile  target  acquisition  is 
perfect,  a 155mm  howitzer  battery  under  attack  by  a 122mm  multiple  rocket 
launcher  battery  can  preserve  65  percent  of  its  combat  capability  by 
moving  to  a new  area  if  the  old  area  can  be  cleared  in  10  minutes.  It 
is  critical,  however,  that  the  type  of  arriving  hostile  ordnance  be 
recoonized,  since  other  types  may  produce  different  results  and,  hence, 
different  required  actions  for  survival. 


(2)  The  ability  of  a 155mni  howitzer  battery  to  defeat  hostile  target 
acquisition  is  critical  to  a surviving  combat  capability. 

b.  Another  analysis  was  conducted  to  comoare  the  foreaoing  methodology 
with  the  fixed-nercentaoe-loss  theory.  A large  number  of  i22mm  multiple 
rocket  launcher  counterbattery  attacks  on  a 155mm  howitzer  battery  were 
conducted,  and  the  residual  combat  capability  as  a function  of  percentage 
of  personnel  casualties  was  determined  as  shown  in  Fiaure  4.  We  note  the 
followina; 

(1)  Personnel  shortages/ losses  have  a stronoer  than  linear  impact  on 
combat  capability.  A priority  effort  should  be  made  to  improve  personnel 
survi vabi 1 i tv. 

(2)  The  fixed-percentace-loss  theory  overestimates  survivability  for 
the  case  studied. 

6.  Validation:  The  foregoing  methodology  assumes  a number  of  linear  or 
quasi-linear  relationships.  Clearly,  any  suoportable  analytic  representa- 
tion of  the  degradation  of  each  functional  capability  can  be  substituted. 
Data  to  allow  refinement  and  validation  could  readily  be  collected 
durino  unit  field  training  and  evaluations.  Further,  the  concept  of 


REMAINING  COMBAT  CAPABILITY  (%) 


relating  personnel  and  materiel  losses  to  degradation  of  tunctional 
capabilities  has  equal  application  to  any  military  unit  for  which 
survivability  in  combat  is  of  concern. 
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ABSTRACT:  An  equation  (A)  is  iteriveU  whirl)  preiliets  the  numl»er  of 
attempts  one  wouUl  exjieet  to  m.ike  to  aehieve  an  ohieetive  whieh  has 
only  two  states,  i.e.  sueeess,  failure. 


The  ojuation  is  partieularly  useful  in  the  analysis  of  firepower 
systisns  which  can  chan>;e  methoil  :inil/or  type  of  munition  delivered.  It 
can  he  used  to  determine  the  expecteil  depletion  rate  per  success 
associated  with  a yjiven  stratejjy  or  to  determine  the  optimum  strategy 
resultinj;  in  the  lowest  depletion  r.ite.  Since  time  to  kill  is  a mono- 
tonic function  of  the  numher  of  attimipts,  the  equatimi  is  a 1 si)  useful 
in  assessing;  lethality. 

A strategy  is  defined  as  an  ordered  sequence  of  attempts  i)redicated 
on  failure  of  preceedini;  attempts.  Tach  sequence  is  partitioned  such 
that  the  prohahility  of  success  associ.ited  with  an  attemi't  in  a suhse- 
quence  is  indeiiendent  of  the  prohahi 1 i t i es  associated  with  attempts  in 
all  other  suhsequences . Interdependence  within  a suhsequence  can  exist. 


The  deriv.ition  is  described  and  examj'les  t;iven  for  the  t'ol  lowing: 
equat i on : 


^ (1  - n,  ^ * '^k  ■ ’^k^ 

k=i 


In  - Ixpected  numher  of  .ittemi'ts  to  first  achieve  the  ohieetive 

T = Total  numher  of  suhsequences  m .i  ode 

^k-1  = The  prohahility  of  fa  1 1 i ni;  all  .ittempts  through  the  "h**'" 
suhsequence 

N.  = Numher  of  .attempts  in  the  "k"  suhsequiaice 


N 


k-1 


^k  = 


i = l 


'’k“ 


I’.  (il~  Trohahilitv  of  at  le.ist  one  success  h)  thi'  "i'*'"  attei 
the  "k*'"  suhsequence 


mpt  in 
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INTROiniCllON: 

An  eijuation  is  ileriveJ  which  predicts  the  inimher  of  attempts  one 
would  expect  to  nuike  to  achieve  an  ohjective  which  has  only  two  states, 
i.e.  success,  failure. 

The  equation  is  particularly  useful  in  the  analysis  of  fiiepower 
systems  which  can  change  method  and/or  tyjie  of  munition  delivereil.  It 
can  be  used  to  determine  the  expected  dej'letion  rate  per  success 
associated  witii  a fjiven  stratefjy  or  to  iletermine  the  optimum  stiMtejiy 
resulting  in  the  lowest  dejiletion  rate.  Since  time  to  kill  is  a mono- 
tonic function  of  the  number  of  attemiUs,  the  equation  is  also  useful 
in  assessing  lethality. 

nil:  I’ROBI.IM 

rhis  is  an  expected  value  jn-oblem.  Iv'e  wish  to  determine  tlie  number 
of  attempts  one  might  expect  to  make  to  achieve  a binarx’  ob  i ec  t i ve*  for 
a given  strategy. 

By  strategy,  we  mean  the  sexiuence  of  attempts  whiclt  are  planned  ti' 
achieve  the  objective.  It  will  be  convenient  tix  represent  each  strategx 
as  a sequence  of  subsequences  of  attemins,  i.e.,  {Sjl,  Ui  ■>  I , l!i^) 

where  (Sjl  represents  the  sequence  of  the  first  N|  ;ittempts, 
reixresents  the  next  Nj  attempts,  the  next  attempts  and  si'  on. 

This  sectioning  of  the  sequence  is  done  ti'  take  .iih.int.ige  I'f  intr.i- 
sequence  similarities  which  will  great  1>'  reduce  the  numbei-  ot'  required 
calculat ions. 

for  example,  assume  a man  is  attempting  to  break  a bottle  witli  a rit'li 
having  ten  shots.  Assume  also  fhat  one  wishes  to  analvze  the  str.itegx  of 
firing  two  rounds  to  register  and  eight  for  effect.  B\'  sectioning  this 
strategy  into  two  subsequences  of  two  attemi'ts  and  eight  attenqits 
respectively,  it  can  be  shown  that  onlx  four  terms  neeil  In'  c.i  1 cu  1 .it  ed . 

If  done  otherwise,  over  ten  terms  must  be  individual  1\  c.i  1 cu  1 .1 1 cil . I'he 

advantages  will  become  clearer  as  the  note  I'rogresses. 


which  has  onl\  two  states,  success  iir  t'.ulure. 
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I'lu'  oxpootoii  valiio  of  tho  numhor  of  attomnts  to  first  aoliiovi 
tho  ohiootivo 
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Tiu'  ith  siihsoijiionoo  of  at  tomtits  in  a stratoi;v 

I'ho  numhor  of  attompts  in  suhsoquonoo  1 !i  j 1 

I'ho  proliahility  of  acliiovini;  at  least  one  suoooss  in  "j" 

.ittompts  of  suhsoquonoo  (§.}  I’.ivon  that  all  attompts  in 

iirovunis  suhsociiionci's  faih'‘kl*  (\'ofo;  I'  ( i i l'.(o)  = o,  . ) 

o ■ ,1  j 

I'ho  prk'hahility  tltat  tho  Jth  attomi't  in  suhsoipionoo  t 5 . 1 
is  tlto  first  suoooss  in  suhsoquonoo  i !' j I 

Tho  tk'tal  numhor  t'f  attempts  prior  tii  tho  "i*!"  suhsocpii-noo , 

i . o . . 

j 

s.  = N. 

I'ho  total 
itsol f , 


An  artifioial  tariahlo  ilofinokl  as 


i'ho  prohai' i 1 i I V of  I'ai  lures  titt\ni!',h  attomuts,  i.o.. 


numhor  of  suhsoi|uonoos  hoforo  stratoin  ro]ioats 


.0..  r^iiiv. 


If  I'lto  ohoosos  to  klofino  tho  suhsoquottoos  suoh  that  thov  are  inklo|ion- 
ilont  ot'  oaoh  other,  tIu'  ootiklitional  ast'oots  Jisaiiuoar. 


i){;rivation 


By  definition,  the  expected  value  of  a i|uantity  is  the  sum  of  all 
values  ot  the  quantity  multipled  by  their  probability  of  occurence. 
This  means, 


1 

1-.^  = i;{i}  = 5:  i*p  (i)  + |i-p  (N  11  • r"  (i+N  i*p,(ii  + . . 

i=l  * i=l  ‘ ‘ 
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Assume  that  after  attempts,  the  stratefiv  repeats  itself.*  Then: 
i \ 

f-n  = ^ l”tl'  * '\-i  *1 

.1=0  k=l  i = l t t K 

where  is  the  probability  that  success  does  not  occur  in  ".S^"  attempts. 
With  little  difficulty  one  can  show  that 
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P.  (i1  = P|_lil  - Pj,ti-n 


and  that 
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With  these  identities,  equation  (21  can  be  reduced  to 
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.1=11  k=i 
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*For  example,  a tank  has  a finite  complement  of  ammunition  after  whicli  it 
must  reload  and  engage  again. 
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The  infinite  series 
the  simple  relationships 


can  be  put  in  closed  form  solution  by  remembering 
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i=0 
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Equat ion  (6)  becomes 
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With  more  work  than  is  probably  warranted,  equation  (9)  reduces  to 
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T 

r 

k=l 


(i-nj  f'^k''*'kl 


(10) 


Equation  (10)  is  the  solution  to  the  question  at  hand, 
may  show  its  application. 


The  following  examples 


examples 


LlJc Const  ant  probabilities  of  succes s . 

the  problem  at  hand  is  one  where  each  att 
probability  of  success. 


Every  so  often,  the  .sun  shines  and 
empt  has  an  independent,  constant 


If  the  probability  of  success  is  designated  as 


"p"  for  each  attempt, then 


’k  ■ '’’kdl  . n,-[MA^I 
1 = 1 ^ 


N,  N, 


= (1-p)  *(l-p)  ^...(1-p) 


N.  -1 
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I'hus,  equation  (10)  becomes 
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not  a very  stunnin}’  result.' 


('.-2.  Constant  probabilities  which  chanjic  with  sequence.  Sometimes  the 
probability  of  success  is  constant  for  each  attempt  within  subsequences, 
but  has  a different  value  for  each  sequence. 

I.et  ' |V"  be  the  probability  of  success  for  each  attempt  in  seiiuence 
k,  then 


k 


1-p 

P" 


N 

U kj 

k 


.Subst  i tt/t  ion  into  eqii.ition  (10)  results  in 


1- 

n 


; k-1 


(1  -'\)^k, 
>k" 


Int  radepenOent  attempts . In  this  ex.imiile,  the  pn  .ibility  of  success 
of  each  attempt  within  a sequence  is  implicitly  dependent  upon  tlte  success 
or  failure  of  previous  attempts.  This  is  the  case  with  most  fire[>ower 
systems  which,  unfortunately,  are  plaqued  with  random  .iml  bias  errors.  It 
is  the  latter  which  causes  the  intradependence  whereas  chanjtinj;  munition  typos, 
choosing  a new  aim  point,  etc.  causes  the  interdependence  of  attemins. 

Assume  one  is  anaU’zing  .i  fire|iower  system  which  has  an  eri'or  budget 
table  such  that  random,  variable  bias,  and  fixed  bias  error  li i st r i but i ons 
are  known  for  the  range  in  question.  Also,  assume  fh.it  the  conditional  kill 
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r Villi'  if-n 


1 


prohah i 1 i tv  can  bo  roasonably  ostimatoil  for  tiu'  tarj;ots  of  intori-st. 
llsiii^  tlio  followinj^  vlof  in  i t ions , wo  sot  nj'  tin-  solution,  lot; 

ix,  yl  spatial  variablos  i ml  i cat  i ni;  the  imp;ict  point  of  tho 
proioctilo  in  tho  piano  of  tho  tarjjot  . Tlio  piano  nia>  bo  ilofincil  as 
vortical  or  horizontal  dopotulini;  on  weapon  t>po,  o.v;.,  tank,  artillory. 


n ,n  variable  iloscribinj;  tho  system  bias  consist  in.y  of  both 

a fixed  aiul  vnriablo  bias. 


' . V’ 

K • K 

X V 


il  i root  ion  . 


'Vx  "v 


tho  variance  of  tho  ramlom  errors,  in  tlie  x ami  v 


tho  variance  of  tho  variable  bi.ises. 


tho  fixed  bias  in  tlio  x and  y direction 

P (x,\’1  the  conditional  |irobabiliti  tliat  tlie  t.ir^et  will  be 
^'k 

defeated  if  tho  proioctilo  impacts  at  point  x,  c in  the  "kth"  soquenco. 

Xssunie  that  all  emu-  sources  have  norm.il  distributions.  I'urther  define 
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dxd\ 


which  is  the  iu-oImI' i 1 i t v of  defeat  iiiv;  a tar.ci't  with  an  attempt  >;iven  sjH'cific 
values  for  n^,  ny  Ni’to  that  fiU'  iiiaiiv-  munitions  .u;ainst  harii  targets,  such 
.IS  t.inks,  tlie  boiinds  of  this  integration  ,ire  limited  to  tho  proioction  of 
tho  taryet  on  tho  t.nyyet  I'lane.  Phis  m'curs  boc.iuso  I\.^(\,v1  = o when  the 

proioctilo  misses  those  target  tvpes.  I'lie  probabilitv  of  killiiyy  the  taiycet 
in  "n"  .ittenij-'ts  is: 
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When  thoso  aro  suhstitutoii  into  eiiiiation  (lOI,  the  oxpoctod  luimbor  of 
rounds  list'd  and  thus  time  to  dot'oat  tho  tarsot  is  oasilv  oa loulatod . 


SUMMARY 


Iho  oquation  tor  prodioting  the  expootod  nunihor  attompts  roquirod  to 
achieve  a hinary  objective  has  been  derived.  These  predictions  are  a necessarN 
injliedient  in  most  systems  analyses.  Ihe\'  are  also  essential  in  determining 
optimum  stratejjies  when  the  object  i\'e-tunct  ion  is  de|iendent  upon  the  number 
ot'  attempts. 

before  concludini;,  it  must  be  pointed  out  that  the  qualification  of 
binary  objectives"  is  not  minor.  Man\  times,  altluiu^h  a previous  attempt 
has  failed  to  meet  an  objective,  it  alters  the  probability  of  future  success, 
.ind  theretore  is  not  binary.  lor  example,  when  a boxer  hits  an  opjionent  with 
the  objective  of  a knockout,  althoujjh  the  blow  fails  to  meet  the  obiectite, 
it  can  sutficientlv  condition  the  opponent  so  that  a lesser  subsequent  blow 
will  be  successful.  With  this  homey  disclosure,  the  note  concludes. 
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Implementation  ot  burvivability  Progriim  for  Weapon  Systems 
Mr.  W.'ilter  Dzingtila 

US  Anny  Amament  Besetirch  and  Development  Ccmimand 


TITLE: 

AUTHOR: 

ABSTRACT:  In  present  times  of  exiiensive  and  sophisticated  weapons,  hivh 

combat  attrition  rates,  often  limited  stockpiles,  :ind  mvnerical  superiority 
01  military  persoruiel  and  materiel  demonstrated  by  potent ita  enemies,  sur- 
vivability IS  becoming  an  element  of  weapon  effectiveness  of  primary  impor- 
tance to  our  ai-med  forces.  This  pai^er  defines  the  tyjie  and  extent  of  effort 
required  lor  an  ellective  implementation  of  a survivability  program  for  Army 
weapon  systems.^  It  reve:ils  and  higtilights  all  essenti:a  factors  related  t^ 
the  weapon  and  its  combat  environment  that  coiad  affect  survivta  of  Army  wea- 
pons on  a battleliold.  fiirther,  this  paper  outlines  a program  procedJi^^  for 
a sptematic  evaluation  of  these  factors  in  the  context  of  a total  weapon 

Sprwe^ents?  "“"^-effecti ve  weapon  survivability 
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IMi'lJ-lNffiNTATIOK  OF  OUKVIVABl LITY  FRCX-.i^AM  FOR  rtFYM’ON  OYi'TFFt''. 

Mr.  'rt’ilter  Diriiitinla 

U..’.  AnTi.v  AiTi.'unoiU  Rorear ’h  and  Pevolopmeiit  Coranand 

It',  {'resent  t i.mes  of  ex{'ensive  and  soptiisticated  weai'cn.",  hi{."h  eomPat 
attrition  rates,  often  limited  stock{'iles  and  ineroased  vulnerability  to 
cieteotion  and  su{'{'ression  by  enemj’  action,  wea{'on  survivability  is  becotninc 
;i  ir.ilittiry  discipline  of  {-rinary  i.mi'ort  .anoe  to  our  armed  for.-e.s. 

Todtiy,  wbetiier  desiftnintt  a new  wetipon  or  im{'rovin(:  thi'  existing'  one, 
we  must  ask  ourselves  not  only  wtiat  can  we  do  to  mtike  'lieso  wea{'ons  {'crform 
better,  but  also,  witti  equal  importance,  wtiat  can  we  do  to  im{  rove  tiicir 
stiaitce  of  survival  on  a battlefield.  In  ot  iter  words,  otir  ob/ect  ive  in  'he 
weapon  developmen*  irocess  must  equtilly  -tre.ss  {'er t'ormance  ;mu  surv'val. 

[’.his  ettrpftti.'is  on  survivtibi li • y h:ts  been  refle-'ed  in  the  PAROO.M  t'olisy 
of  recent  years.  .Accord  i ns  ly.  ‘lie  tia.'  been,  vie.-iftnat  ed  as  a lA'ad 

Activi'y  for  survivability,  and  survivabili' y propr^tm  re.niirement  s iiave 
beet',  set  for  PAKOOM  element  s . Tltese  requi  remen.t  s can  t'e  j ai'at'ttrased  a.' 
t’ollow.- : 

•ftirvi  v.abili  t y .-onsiderat  ion.-  tind  invest  ip.a*  ion.'  will  be  applied  'o  the 
total  life  .'y.'le  of  a weapott  system. 

•f  urvivabili  ty  requi  remeti' - will  bi.'  iticluded  in.to  mn.teriel  t'lattnitis 
docurit'nt  s . 

•PAKCPM  elements-  will  establish  their  own  survivability  implementation 
propr.'utis  and  will  develo{'  needed  capability  for  cottdustin.c  surv  i vttbili  t y im- 
provement invest ipat ions. 

rtie  i'urt'ose  of  ttiis  pa{'er  to  offer  a set  of  ptiicielin.es  t;ia'  .'oul.t 
assist  in  t tie  imi'lement  ;it  ion  ot’  PAKfPM  .-urvi  v.abilit  y procr-ur.  t’or  Army  assets 
sucli  a.'  wea{'on  syste.ms.  I’tiese  puidelines  could  be  samm'.ed-up  -is  I’ollow.-; 

•Pet’ine  t lie  s-sope  of  your  prosiaim  by  first  det'itiinp  'tie  wetipon  surviv:i- 
bility. 

• Identify  factors  that  could  affect  the  survival  ot'  your  we-ncoti  system 
on  a battlefield. 

•Fstablis-ii  a meclianism  for  evaluation  of  tt'.ese  t’:i.’tors  attd  -onsente:" 
identification  of  survivability  improve.ment  .•  witii  p.ayot';’.-. 

• Fst  ablisti  a workable  I'rocedure  foi'  impletaent  at  ioti  of  .'urvivabili  • y i-t- 
{■'rova'ment  s . 
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To  define  the  rant'e  of  our  proirr'tm  efforf,  we  must,  first  ol'  all,  del'ine 
survivability  as  it  pertains  to  our  propr-im  needs.  Fifure  1 s.hows  that  the 
definition  could  vary  in  scopie,  depending  on  what  we  want  to  include  or  not, 
into  our  program.  In  situations  where  some  survivability  activitie:-  already 
exist,  the  extent  of  our  program  must  be  adjusted  accordingly. 

Having  defined  the  scope  of  our  progr;im,  next,  we  must  attpm]'t  t.o  icien- 
tify  those  elements  and  factors  that  could  affect  survival  of  our  weapons  on 
a battlefield.  Figure  2 shows  four  basic  elements  of  wehpon  system  r-urviva- 
bility;  detectability  (oi‘  target  acquisition),  hitability,  vulnerabi li * y to 
damage  and  repairability.  In  otiier'  words,  tlie  survival  of  our  wcaj^ons.  on  a 
battlefield  will  depend  upon  how  'vulnerable  our  weaT.'Ons  are  to  detection 
and  location  by  enemy’s  target  acquisition  equipment,  how  '/ulnerab’  • liey 
are  to  being  hit  if  detected,  -md  how  vulnerable  tiiey  are  to  d'lmage  enemy 
.munitions  if  hit.  Their  survival  will  depend  also  orj  how  ea.'ily  they  r'ould 
be  repaired  when  damaged. 

A mathematical  relationship  of  the  weapon  survivability  '.o  t.hese  !our 
elements  is  shown  in  P’igure  3-  This  is  a basic  survivabi  li ‘,y  .model.  It 
can  be  seen  that  our  sur'/ivability  improve.ment  goal.:  should  be  pursued 
throu^'h  the  reduction  of  tiie  vulnerabili '.y  oJ'  our  weaj'on.-  'o  being,  dc-t.ec'ed, 
to  being  hit,  to  being  damaged  when  hit,  and  by  makit.g  our  weaj.ons  easier  to 
repair  when  damaged. 

The  four  survivabili ’ y elements  defined  above  mus-  b'-  rda'.ed  '.o  various 
in' er-actions  betv;een  our  weapori.c,  the  enemy  thrs-a'  ar.'i  ' t..  -omba'  enviro.n- 
.men* . 


Le*  u"  •onsider  the  fir.:t  element  'in*,  '-an  affo  -'  ‘he  . urvivaldll'y  of 
our  •veapon.'-  - the  detectability  (figure  •’»)•  Thus,  ’..be  valni-rai.ili • y oi’  our 
•weapons  to  detection  aiid  location  by  enemy  i'or'^e  ■ will  fiejiend  on  ' tie  sigria- 
tures  that  our  "eapotis  present,  the  enemy  abili'y  ‘o  exqloi'  them  I'or  loca- 
tion of  our  weapons,  O'ar  aisIUty  to  ■ounter.meas'ure  .such  ene.my  effort:-,  and, 
in  turr.,  hi.:  ability  to  oppose  our  '•our.ter.me'i.'ure.' . Al.:o,  ther'e  fact-ors  of 
o'lr  '.veapon  anti  the  enemy  'i.reat  effe-'-'.ivenc-s,:  will  be  influerr-e'i  by  a ^'omba' 
er.’/irormen'  - we'ither,  terrai:  , and  '"ombat  .:ituation. 

Likewise,  '.he  proba'oi  li'.y  of  being  -hi',  by  ene.my  fire  (figure  S)  will 
dOT'end.  to  a grea'  measure,  on  ' .te  t erfor.man -e-  of  ene.my  'weapons  wit.h  respect 
to  their  range,  hi'  a^cura-y  and  response  ‘,ime  and  ‘.he  'yrje  of  tactic.s  em- 
ir loyed . 3u'  ‘he  chan^-es  oi'  beir..-  nit  will  -il 'O  dcp'end  upon  o'ir  '-.^pr^bility 

to  -ountermea  •tu'e  ‘hi."  ene.my  ei'i'or'  throUf'h  ‘he  ef i‘e''ti’/eriess  of  our  weapons 
•;.'a‘  -ould  heir  us  to  eit.-.er  'ivoid  t.he  orgsmy  a‘t‘i"k  -,  or  to  counteract,  ‘he.m 
■.•.•i‘.t  our  .‘ur ; re.'.slve  fire.  Thu.',  i.m.T  ro'/e.mer.t.:  in  our  ‘weapon  pjerformance 
■u  as  .mobili‘y,  hi‘.  accura'-y,  lethabili'y,  cxter.dod  range  of  engagements, 
rari'j  response;  or  imrrove.ments  ir.  •.■/e'lT.on  ot  era*. ion  sut-h  a.",  training,  tac- 
' 1 a.-.'j  lo.'i.-'i''  .‘uppor'  -ould  redo -e  t;ie  "irobabili'y  of  being  hi*  and 

■ O':  -e  .m.’us*  to  ir.'-luded  ir.  our  "on.'idera'.ion  of  fa'^'tors  affecting  .survivabi- 
li‘y.  .Here  a.'ain,  t.he  effe  •*  of  '■omba'  ers/iroament  .mu.st  be  taken  into  ac- 
"ou.-",  ‘ . 

Ts.e  damage  su.‘t'ained  by  our  -weapon."  and  personnel  (figure  6)  will  de- 
ir.  ‘ i'lr  pla'-c,  on  the  iethali‘.y  of  ene.my  munition."  or  the  severity 
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'-he  o*'  or’.iinii'y  C' 

I'.vi  ■■.lju  on  -n’-  '.VT'!-  oi'  nrooc  L 
i'Le;:.e’'.'o  ol'  '.ailnoi'-ih  1 li  y ha 
ao'-s  .-.O'  require  mor'-  elahor-ii.L.i 


ir'/iary  environments.  But  it  will  de- 
i-’f.t  vrs  can  provide  against  such  threats, 
■eady  Been  extensively  studied  and  hence 
this  tiijne. 


; ':ri.lly,  Che  elemen'  of  r 
e-i.:  ily-' o-j'ep'iii'  -tviracteri'' ‘ 
le-.-el  Ol'  logi  " 1 • ■'I'DPOi'*  ■n-’-  iv 


my  ability 


d ! Tu;  ■ • i:ls 


-i  ' 'c.bi.lity  (figure  7)  will  depend  on  the 
e.'  irui^rent  in  the  design  of  our  weapons,  the 
i led  "''■■■  their  repair  and  replacement,  the  ene- 
ooi-'  e •"■'ort , and  also  on  the  effect  of  combat 


enviroimien' 


Merely  ideatii'i 
little  value,  iui2e.  .- 


:i  jn  of 


t!  eir  sigr  i 


■uu!  a.'.sessed,  and  '^he  n ..tint 


"S  affecting  survivability  will  be  of 
f.cence  to  the  weapon  survival  is  understood 
"'"'■nsing  improvements  are  incorporated  into 
■a  weapon  sy.-tem.  For  this  pu.'-'s-se  ve  need  an  effective  program  mechanism 
strucLui-ed  around  the  frumework  of  tlie  Svrvivability  Improvement  Process 
(figure  P) . This  process,  norma  lly,  v;i;..i  consist  of  five  different  but  in- 
terrelateu  stages  involving  manage, .il,  ane.lystical  and  engineering  efforts. 
In  'ohe  fir.:'-,  . ‘age,  the  \n.ilnerabili ty  of  the  viaapon  system  (that  is,  the 
threat  jjoseti  i.o  ‘ h*-  weapon)  is  assessed  end.  thus,  its  existing  survivability 
level  is  de'i.o."minod . Boring  the  second  stage,  various  vulnerability  reduc- 
tion appi'oache.s  are  identified  atid  explored.  These  efforts  should  yield 
vari.DMS  sin-vivabili  t y ijiun-ovemenc  potentiaf-S.  In  the  third  stage  these  im- 
prove.-nent  potont.ials  are  ruojected  to  trade-off  analysis.  Improvements  w'ith 
hig:i  payoi'i's  ai'e  selected  ai.d  recomit-nded  for  implementation.  In  the  next 
stage  of  the  curvi vahili by  proces",  selected  improvements  are  implemented 
into  '-he  weapon  .syste;;'.--v.'eaD'‘:i  uesign.  training,  operation  and/or  tactics. 
Fin;iliy.  af;.er  the  im.plementation.  the  survivability  is  re-assessed  and  a 
.".eed  for  any  fur'ther  ij.iproYements  is  determined. 


Duri.'ig  t!’e  early  p na.sGS  of  the  v-'eapon  development,  these  survivability 
‘hmctior.s  will  bo  les.-.  der.innd:' ni,  f,nd  rather  general  in  nature;  but  later  in 
< he  de . clopmen', , moi’e  sophis f'.cated  analytical  approa'^'h  requiring  mathemati- 
cal ::!odeii;.g  ard  field  demonstration  wi.ll  be  needed. 


I'Or  our  pro'’rs::i  'o  suc  ’ead,  thi.r  Survivability  Imrrovemen*  i rocess  .must 
0 i ncorpoi'ctei  ^nto  and  be'’ome  an  in„egral  par'!  of  the  weapon  syste.m  life 
cycle. 


The  Survi vahi iity  Imp ro'.x-mf .’1  P'.'ocg.'g  contains  two  .’Tia.-'or  and  basic  pro- 
g2'ar,\  'L'’.u'ictions--as5e3sment  o:'  weapon  vu.l.ierability  aiid  evaluation  of  '.nilnor-t- 
hi  iity  reuuctio."  potential.'.  Tc  pc;r'’or.m  • hese  two  func'ions,  appropriate 
analyt.ioal  p "occ'^urcs  .must  be  devs-.'.O;-' t-d  and  applied. 


.'Is  an.  e.x.amp''e.  si  ov.ai  here  .■''i.gn.re  ■ is  an  ou' line  of  ‘“he  firs-  par' 

of  a proce-i’Ufo  to  ue  used  for  tiic  vs.l  terability  assessmen'  of  o'..tr  weapon, 
systesi  to  enemy  tar;  et  acquisition  throat.  Th.e  aiialyical  .--eps  shot;  that 
the  -essment  of  ^nem'''  targe*'  acq'uisi- ion  rotetf  ials  ('.-.'i'.h  resre -t  ‘o  range, 
accur-icy  and  time)  must  be  based  c.';  .-o.nsidera- ion  of  tne  effe'"-.'  of  o.ir  nc''-- 
pon  signatures,  one;ny  sensor  ’•.tp''bili ■ res  ar.c,  ba-'lefied  ec'.vironmen' . Inis 
cst'e-t' ment  .must  t len  be  co.aq '’red  wi  h target  aco.ui 'ition.  needs  dicta-ed  by  a 
'pmrticular  combat  situ'-tio:.  in  ordo  • _o  yield  vulnerability  (i.e.  de'e'‘ati- 
li  ty)  nssessmetit. 
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VvillU'r.'ll'i  1 i t >•  ('foviiio  U;'-  with  diri'ftioil  l\i|-  t'ncIluM'  -1  -I  il'li 

tltoy  fi'vt'iil  to  u.'.  till'  iifi'ii;;  wlu'fi’  vulin't-.'ihi  1 i l,v  I'l'ilui't.  i oti  lu'i'ii.'  •n'l'  my  i-iit  . 
'I’lil;-.  I'r  liif.',:’.  u;i  to  t hi'  iii'ooiul  I'.'ift  of  ouf  •iii.'i  ly  t i I'M  I pfoci'ilufi".  'I'hi'  l\t'iUi>'t  ion 
ol’  Vuliii'i'ahilJ  t y to  'r;u>ti't  Aoi]u  i ;ii  t ion  (l’ir'if<'  lO).  Ilofo,  vnriou-  j'oii'uti'il 
foe  t ill'  I'l'itu.'t  ion  of  if.nnt  ufi'i;  niui  fof  t ho  cior.f.'uint  ion  of  t ho  onomy  l•ll•(•ot 
tioqui  i I Ion  oapnl'lli  til'll  nro  i nvo:' t ij'int.i'd  and  aiinomod  witli  rooi'i-ot  lo  ' ho  i r 
Impaot  on  oont  and  ponnihlo  do(',t’'nlnt  i on  of  woai'on  o f fool  i vono:';- . Vulnori- 
t'ility  foduot  ion  moanufon  with  hif.h  payi't'f:'  afo,  in  offi'ot  , onr  .-nfv  i vat' i - 
lity  Improvomont  n , noloi'lod  fun  iinplomont  at  ion. 

thioh  analytioal  pcooi'ilufon  muat  t'o  dovolo)'od  for  t ho  ao.  oao.mon'  ot'  othi-r 
olomonta  and  othoi-  |■aotoI■a  of  t ho  aurvi  vahi  I i ly . Thia  ia  a anl’ayati'm  and 
oompononi  approiu'h  to  vulnorabi li t y and  vnlnorahi I i t y rodnot  ion  aaaoaamoni a . 

A niiifo  aoph  i at  iv-a  t od . ayatom  ai'proaoh,  will  ho  to  oonaidor  all  faotora  al’- 
foi'tlnp,  lUirv  ivah  i I i I y a imu  1 1 anooua,  ly  in  oontoyt  of  'i  total  woapon  ayatom. 

Hooaua.o  ol'  ita  oxtonaivo  ranpo  and  oomplox  i t y . t lu'  woapon  airv  i vah  i 1 i t y 
propf'uti  ahouKi  ho  oatahliahoil  and  implomont  od  oradiially,  pn'fi-rahly  in  'hri'o 
phaaoa  . 

i’ho  firat,  t ho  propai'atory  phaao,  a.lionld  I'ti’ompaaa  adivitioa  ‘ha*  ari- 
rolatod  to  t ho  a.  t ru.'t  uriiip,  and  t ho  oat  ahl  i aiimont  of  tho  pi-opr-utt  i'-iao.  'I’tm  ■ , 
t'.nidol  inoa.  for  aurv  i vah  i 1 i t y oona.idorat  iona-  durinr,  a woapon  1 i fo  •yalo  with 
aurv  1 vah  i 11 1 y miloatonoa  muat  ho  oa.t  ahli  ahod  . rtio  aa.a.o'iatod  proafuii  aur- 
vivahilily  t\inoliona.  and  taaka  auiai  ho  dofinod  and  ■ ho  i r I'unditift  noon  ■ oa'i- 
matod.  I''urthor,  1 lu'ao  funi'*iona  and  t-iaka.  muat  ho  aa. :•  i .••no.i  ‘o  variou'  olo- 
monfa  ot'  tho  'ommand. 

Puritii  thia  phaai'  groundwork  mua.t  ho  prop-irod  for  analyti.-al  I't'fort  a 
plannod  for  .lati'i-  phaaoa.  of  aurv  1 v.ah  i li  t y aotivitioa.  i'hu  • , variou'  intor- 
rolatovl  t'a.'tora.  and  pafutii't  ora  tha'  j'.ovorn  'ho  woai'on  -urv  i vah  i 1 i 1 y out  -omo 
mu.'t  ho  do  t orm  i noii , and  plan.'  'ind  -liialytioal  i-ro.'odtii'i'a  for  i nvo.- ' i ("i  l i on 
ot'  • ho  i r of  foot  a on  aurv  i val' i 1 i l y mn.'‘  ho  out  I i non. 

A'  thi,'  t imo  -iny  v'n-.'oin.'  IXM'  pro'oo'a,  on  or  ri  Pitod  'o  aurv  i vd' i 1 i ' y 
mu."  ho  idon'ifiod  -la.d  roviiivoi  'in.i  ' ho  i r 'iprl  i.-ai  ion  ' o wo'ipon  .'Urvivahi- 
li'y  iio' orml  tio.i . I.ikowiiti,  your  orp'in  i .'i'  i on  ' pot"  ion  ot'  il/\  prodoot  .-(lontd 
ho  roviowod  wi'h  'hi'  purpo 'o  of  dot  onai 'i  i np  it'  'uid  how  .'urv  i vd' i I i t y nood.- 
h'U’o  i'oon  -I'n.' i di' rod  .-o  i'-ir.  iro.h".'  l-i.-Kinp,  or  ’.I'itli  itrnio.nia'o  urviva- 
hili'y  ir.rrovomon'  j-l'in.'  ahould  ho  idi'ti'  i fiod,  'ind  proafutt  la'iu'at.'  'o  t'i  1 1 
oxia'inp  .'ap  ■ .ihoul.i  ho  i 'i  j ' i -i  • < ci . i'urinr  ’hi."  i'h'io,  .'onr-o.-  of  d'lla  aii.i 

oxpor'i.'o  in  .'urv  i vd' i 1 i ' y r'l-i'i'd  di  'ipliuo'  mu.''  ho  i .l('nt  i i' i od  witli  «'on- 

t'l''  ■ o"'dl''hi'd  'ind  ■ ho  i r , 'up;  or'  'I'-nro.i. 

'.'In  o 'O’ld  ; ha.'o  .'f  'ho  j'rorr'V’i  'i.'uld  ho  dovo*  od  'o  'ho  oxplofit  ion 
o.'  v'it'i..'.i'  ' irv  ’ v'lh  i 1 i ■ y no' '"i*  i 'il  . A-'ivi'io.-  iuriui',  'hi'  pha.o  aro  oin- 

r-i.'' or  ! ao. I ty  -■  ".it'.'y."  o”i  ('>•  ' •'mi'Otio!.'  'ip'pro'i  "i.  hoth  .tual  i t -it  i vo  atui  quau- 

'■.'-I'i'v'  ''liio'  Li"i.ti!i!  ' 'urv  i vih  i 1 i t y i-arro /o  a 'tit  propo."'ila  'iri'  ootidu'ti'd. 

if  ' iio  ri  k 0''  i all  In'". i o'  o''  ' iioao  pr.'poai'd  i-ai'i-ovomon'  ■ i low,  t hoy 

'ould  ho  ro 'oaiaiondod  'ind  i’aplomi'n' od  into  a wo'ipon  .'ya'o'a  a'  thia.  timo. 


I'l: 


TIu'  .'I'-'oiiii  pli.'i.’i'  iriu.M  bo  inilinttvi  with  two  m;i,  oi’  I'foro.iui  i t v'  ;u-tiviiit 

i i : i ,'iiui  ovi  I u;i  t iop  of  oy  i :;l  inp,  h.'ila  rolptoii  to  wo-u'o'.i  viiln'M'i- 
i'ili;.\  ;i!lh  to  I'twiu.M  ion  I'l’  tiii:'  vuliii'ivit' i 1 i I y.  ■iii'l 

• A • iui i t ion  •it\h  ovnlnntion  of  nvnilnl'lo  anal.vM  i onl  aiui  ■•imnja:  ion 
I iuf'  t v'.-iu\  i luo.' . 

Iva.’Oii  on  liita  ana  i'\ a Ina ; i iMi  1 oaiin  iqilon  no  aaqnifai,  woaiw'n  vvilnot’abi- 
li'it':'  aro  aar.i'.aaai  at  a auia-yat  opi  oompoiu-nt  h'Vi'l.  'i'lun-.j  a.-nannaiiont  ;■  imi.-'-t 
!(’  folattai  to  vanioa'  t' I omon  t • aiui  'latoi':'  ai’ftvt  inp  nui'v  i vab  i 1 i t y nitah  an 
. ipnat  uro;'  of  onr  wi'iponn,  aapabi.lity  of  ononiy  tai'piO  aa.pii  .ition  oauipmont, 
or'  foa  't  ion  t imo  ot'  inu'wy  woaponn, 

rh'\!  . I'a.aai  on  .'u 'It  vnliu' fab  i L i t y annonn.mont  , vafionn  vtil  norab  i li  1 y 
fiain -t  ion  v'f  .aif v i val' i 1 i t y i Mif-rovofion t fioanuia'.-  aia-  iaontit'iiai  an>i  af  lan  ;a,ai , 
I'lnaa'  ol'foi't,-  a, fain  nnnt  folato  .'lift' i \ at' i ii  • y .impi'ovi'mon:  valiio.-  to  ifoat 
laaiii."  iott  ttioa.ana-.-  .■'.wli  a.',  .'ipnaturo  foau>-tion,  i-\'M,  v'-ynont'lapi'.  mob  i 1 i ' y or 
armor  t'oif  o.-t  ion. 


fitially,  t lio  mo.-t  ptV'in  i inf  , low  rirk  rnrvival'i  I i ty  improvomont  ;■  aro 
impli'fiont  oa  into  t!io  woapon  nyati'm. 

i’iio  tiiiiai  pliano  of  t ho  proffuii  ahi'nloi  ia-  .'onooriuai  witli  v'pt  iini , at  ion 
of  woapon  riirv  i vab  i 1 i t _v  . i'tu-  not  i v i t i or  linrinr,  tiiir  oiiaro  aro  :aoro  rotai'lox 
anb.  alro  aioro  oxponr.  i wo . Uma'.  iuiatoi'our  olo-iontr  ajia  I'!irtv''rr  al't'ort  inf  rnr- 
vival’ili'y  ittiprox  ivaont  aairt  la'  .pian'ifioa  whonovor  I'orribio.  i-'ur:!io!',  'ho 
bnraon  ar  ro.- ia' I'a  witi\  t b.o  ia'.plotaottt  at  i.-'n  .'t'  ni'v  i \ .'ih  j i j ^ i;a.pi'o\ oaion'  ruolt 
ar  iit.'urrt'il  ov'rtr,  liolayoa  proffua  r rl'.oa','. ! o r . -nui  ar.y  'ior.vaaa'.  ion  in  wo-i-ooti 
por  t'oraiaa'!.'!'  I'l't’o'i  i\onorr  aiurt  i'o  wi'ifl'.oa  -ifainrt  t l',o  bi"aol‘it.'  ^i'otii  t a;v  t - 
bio  atui  iiitanriblo^  aori\oa  t'i'oia  t ho  rarv ; \ at’ i 1 i t y itaprovofii’i'.t  • r-tiah  ar  r< - 
»iu  a'.i  rato  .-oatba'  lorror  i;i  oaut'oau'n.t  ana  t'orrottnol.  roauri'a  aoaianar  on. 
lofir'lrr.  nroU'nfo.i  oati  i I'taoti  t 1 i f o , rti'prov  oa  .'orit'at  pv'rtnro.  .'ni'no  bonoi’i'r 
lanrt  v'ttt  wo  ifji  t iio  ourhon.r-  in  oi'vior  'o  ,\iola  ro-ilirtir  ■.'■lyoi';’ ■ . 

I'urinf  t ho  mrv  i v,-ii' i I i . y on ' itai  .n\t  ion.  'oitaro.  wo  -ati,"  roly  itoawily  o", 
:in.a.ly  t i o.'i  L t I'.-iin  iano'  .atia  at.a  t Itortn.  t i .-a.  1 ryr'oia  "tv'b.o  1 i • .r  . .'ito  a;  ■ \'r  •'.'■ivi- 
t ii'r  liurinr,  tlii,-  ph.a.'o  riiouloi  in.'liioio: 

• I'ovi'lopntont  OI'  .-y.-to"!  .-nta  .aib.-y  ■ t I'ai  ’.".oai'ln 

• foLloot  iott  ot'  n.ow  vn Ln.or-n'.i  1 i t y atta  \ at!  ttora'ni  ! ; y ro.iar-'o"  ■ -i 
t hron,fh  I'iolh  .-itu;  1 .•it'or;>  t ory  tort  r. 

• Ar.ro.'..'!aon  t ot'  rnrv  i v;ib  i 1 i t y itaprov  oaton.  t t;iron,rn,  t '.•■!,;ov' -'t'.- . 


•t'a'lo.'t  ion  v''!'  .'O.'t -ot'i'ort  i \ o .'ui'x  i v.at' i 1 i : y iainrov  ot-.i 
ooiainonii.-it  ion  I'^n-  iiapU'ait’nt  at  ion  into  .•!  wo'ooon  r\  r i-  . 


ftirv  i v:ib  i I i t y impi\’vo!ttonf  lanrt  oi  ittrr  lo-ao't' c'a  'i-rott 
'I'liir.  Ok'uIiI  bo  .an  on.f  i noor  i nr.  I't'fot"  ' it  'oof  'o  o'n.l 


or  an  opor.-ition  ot'i'ort  if  it  in\ol\a 
i 


ha'-..-o.' 


b.onlov” 


t’.i  ^ 


• 1",  i 


It,  i;';  iu'.'o;'.;i;u’y  to  om|'ti.'io  i .'o  tli.-it  Ihi,:  t liroi'-ph.'Ko  j’ro»'i''Ut'  ol’l’oiM  ili.'it 
1 tmvo  lU'iu-r  ibi'ii  no!  I'o  o.-irrioii  Mlono  by  :'y:M  om  .'iiiHly ;■  i .■  tn-ovi)':;  tlinl 

.-it.  VJiriou;'.  ooniinaiui:-  oontorr.  I’Ut.  mu:M  bo  oxti'iniod  to  inoludi-  .;,  i- 

ont,it‘u\  onr, Inooi’iiif:,  lof'.h'tio,  n;u>r,  aiui  m:iu;w',omoiit  oU-moiii::  t-o:  |'on.Mbli> 
for  t tio  dovo lopmont  .'iiiii  opi'ra' ion  of  I ho  v/o.-ipon  •yrti'in.  Kir.uro  11  di'piotr 
liow  tlior.o  vnriour.  oiT.nni'.-at  ionnl  olomon!  r.  mual  I'o  involvod  in  t lio  lairviva- 
bility  improvoinont  offort:'.  I’.onorally.  it  .lioulil  In-  tlx-  laa-ponr  i I' i 1 i t y oi‘ 
r.yrd  ojn  or  pro.ioot.  manap.omont  olomont  r.  to  dova'lop  and  orl.abli.  h .a  prop.i-’uii 
bare  for  I ho  woapon  r.urv  i vabi  1 i ty . irum'ly  to  ]'lan,  orp.ani.o,  diroiM  and  oooi'- 
lilnato  inunoron.'  int  orin-t  ionr.  -unonc;  t ho  ot  lior  oonoornod  l^in  d ion.al  oh'mont  ■. 

I'ho  lark  of  roionliflo  and  onpiiu'or  inp,  olomont  a i r.  'o  idontify,  tudy  and 
quantil\.  whonovor  ]'oa:-il'lo,  v,ario\ir  do.-ip.n  f.aotor;-  .afl’ool  inp  . vu'v  i vab  i I i t y . 

In  likowiro  mannor,  loplrtio  -uid  u;'or  olomont.;-.  mu:-t  lio  oonoornod.  with  opor;i- 
tlon.-il  and  onviromnont  al  f.-iot.orr..  in  turn,  t.tu-  :-.y:-tom  -m.-ily-i;-  olomont  ;■  mn.t 
providi'  ,-1  mo.-in  i npikil  in!  oi-pr-'t -it  ion  of  t Inna'  f.-iotor;;  in  -i  oontoxt  of  a tot-il 
woapon  nyrlom  ;iiui  witli  a >'o:d -of  fo.-t  i vi-  .'ippro.-ioh  a;-,  a poal.  Al.'o.  it  i ,■  u)' 
to  ;'y::lotn  .-in.-ily ::  1 olomont.-:  to  oomt'  up  willi  .airv  i v.-ib  i 1 i ! y improvomi'iil  propi'- 
;a-tl:-  oonvinoinp  ononidi  to  ,in;;t.ify  tlioir  implomont  .-it  ion  into  a woapon  .-y.dom. 
Finally,  onplnoorinp  lc>p,i;-.tio  and  \t:;or  olomi'iit:;  mu;d  i-arry  t ho  bnrdon  of  im- 
plomont inp  ;'tirv  i v.-ib  i 1 i t y improvomtait  proi'o:n\l  . 

In  oonol\n-.  i on , lioro  :\\\'  b.-n-io  propr-uti  rooomim'nd.-i  t i on:- ; 

f'Ot  wo.'ipon  :airv  i vabi  1 i t.y  a;-,  an  ob,i('oiivi'  oti  on.n-il  I'ootinp  with  porfor- 
manoo . 

/'.-.-nro  lli.-it  :-.ui-v  i v.-d-i  I i t y ro.piiromont  ■ ai-o  propi-rly  roflo.-tod  in  yottr 
planninp,  doo\imon‘.  : 1 n-orpor.-ito  :'.nrv  i v.-il' i 1 i t y nood:-.  into  t ho  wo-ipvm  1 i f(' 

--y-lo. 

I'ovt'lop  -itid  o;-,  t al'l  i .di  -1  work-il'lo  prorr-un  tno -li.-in  i .'m  for  i dont  i f i .--i  t i on  , 
.diidy  and  implomont  at  ion  of  .-nrv  i v.-fo  i 1 i t y improvomont  witli  pot.on'i-il  I'-iyoff-. 
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ELEMENTS  OF  WEAPON  SYSTEM  SURVIVABILITY 


aged/ 


DETECTABILITY 


Fig. 


HITABILITY 


DAMAGE  (VULNERABILITY) 


REPAIRABILITY 


SURVIVABILITY  IMPROVEMENT  PROCESS 


PART  I:  VULNERABILITY  TO  TARGET  ACQUISITION: 


PART  II:  REDUCTION  OF  VULNERABILITY 
TO  TARGET  ACQUISITION 


TlTl.K: 


Piiramot  r li’  Vu  liu>r;ib  i 1 i t v Moil f I 


All'l'Hl'RS:  Or.  Coslovas  Masaitis  aiui  Miss  Vitila  Wooiiwaril 

O.S.  Army  Hallistir  Rt'Sfarrh  b.iborat  ory 

ARJ^TRAin':  Avallahlo  vu  liuTabi  1 i t v data  tonutluT  with  tbu  assumption  Ibal 

kill  probability  by  a kluotio  onorpy  round  Is  an  antilonio  Ivuutlon  ol  vobi- 
clo  woiplit  and  ranpo  aro  usod  to  dorivo  a paraniotrio  vu  Inorab  i 1 1 1 y mod.-l 
that  doflnos  oundltlonal  mobility  or  flroi'owor  kill  probability  as  a funo- 
t Ion  ot  wolpbt,  ranpo,  aspoit  anplo,  and  distribution  of  ibo  impa»t  point. 


I 


hM 


I’AKAMKTKIC  Vltl.NKRABlI.lTY  MODEL 


✓ 

Dr.  (\’slovns  Mns.iitis 
Miss  Viola  Woodward 

U.S.  Arniv  Ballistic  Rosoarch  I.aboratory 


1 . I lU  rotiuc't  ion 

Trado- oft  critorion  hotween  various  combat  vehicle  cliaracterist ics 
depends  on  their  quantification  and  on  assiRnment  of  a value  and  a cost 
to  eacli  ctiaracter  ist  ic . tbir  armor  and  mobility  trade-off  study  considers, 
amone,  others,  the  probability  p I’f  survivinR  a shot.  Thus,  the  value  of 

this  character  ist  ic  is  its  effi'ct  on  the  probability  of  surviviuR  a cross- 
cinintrv  run  while  under  fire  and  it  can  he  readily  computed  provided  the 
hit  probabilitv  is  expressed  in  ti-rms  of  a vehicle's  mobility  and  other  char- 
acteristics. The  cost  of  an  increment  of  p^  is  exjiressed  in  terms  of  the 

associ.ited  increase  I'f  the  qross  weiplit  of  the  veliicle.  i'he  relation  between 
a cost  i-hosen  in  this  wav  and  the  probability  of  surviviuR  a shot  (p^^ 

the  topic  of  the  presinit  p.ipi'r.  In  principle  we  .ire  only  seekiiiR  ,i  set  I’t 
i nt  e rpo  la  t ii'n  and  extrapolation  formulas  of  vulnerability  liata  obtained  bv 
a compli'x  nunu'ric.il  t r.insform.it  ii’n  of  firine.  .and  damape  test  results. 

We  present  here  the  derivatiiui  of  these  i nt  erpo  I .at  ion  formulas  to  il- 
lustr.ate  our  appro.ach  to  snu'othinp,  the  vu  I lU'r.ib  i 1 i t v data  and  handliuR  .a 
I.iiRi’  number  of  independent  variables. 


Vu  Incr.ib  i 1 i t V D.ala 


Vu  1 ner.ib  i 1 i t V d.it.a  supplied  bv  the  Vu  1 ni'r.ib  i 1 i t v / l.i' t h.a  1 i t v Itivisii'n, 
B.allistic  Research  l.ibor.it  orv  provides  kill  pn'b.ab  i 1 i t v , qiven  a hit.  lY/p 


Thus,  we  obtain  t hi-  rcquiri'd  ri’lation  bt-tween  gross  weight  aiul  pn'b.abililv 
of  surviving  a shot  (p  . = 1 ~ ' ' deri\'ing  such  .a  n'lat  ic’ii  lor  both 


p . .uni  p...  We  descrilH'  beh'w  how  this  rel.it  ion 
K / 11  M 

ner.ibilitv  il.it.i  ci'r  ri'spi’ud  i ng  to  1 I'lnim  API'S  round 
t.irget.  riu'  two  tvpi's  of  kill  prob.ilM  I i 1 ies 


is  derived  from  t lu'  vul- 

• ind  full  <'X|iosuri'  I'l  the' 
,av,i  i 1 .lb  1 1'  .11  1'  c.al  .1st  ri’ph  i 1- 


and  mobilitv  or  firepower  kill  piwb.ib  i I i t i I's , i.e.,  P|^^.|]  bi'  I'itlu'r  t lie 

prob.ibilitv  I’f  tiit.il  li'ss  I'f  .a  e'l’mb.il  ve-hicle  or  onlv  ot  its  mobi’itv  v'r 
firepowi-r.  Wi-  discuss  here'  the  int  erpo  lat  ie'u  .iiul  ext  rapol.it  ion  pie'cedurcs 
for  till'  Litter.  riie  analogous  nu'thod  h.is  .ilso  bi'cn  .ipplied  to  cat  .isl  ropb  i c 
kill  probab i 1 i t v . 


The  conditional  kill  probabilitv  depends  on  r.inge,  .ispect  .mc.le  (the 
firing  direction  rel.itive  to  the  long  i t ud  in.a  1 .ixis  of  the  t.irc.et  vehicle', 
and  the  prob.ibilitv  distribution  ol  the  impact  point.  Av.iil.ible  vulncr- 
abilitv  d.it.a  cont.ain  kill  probabilitv  for  uniform  distribution  ot  the  imp.ict 
point  and  also  for  biv.ari.ate  normal  distributions  with  cert.iin  distribution 
parameters.  The  d.it.a  are  available  for  six  armored  vehicles,  n.amelv.  VnOAl 
(SA.7  tons').  TIO  (SO  tons’).  Tb2  (1"."  tons').  I'SA  (In  tons).  MS‘'l  (ln.,s  tons'). 


I-  .1 1 


and  PT76  (14  tons).  For  each  vehicle  the  kill  probability  with  iinilorni 
distribution  of  the  impact  point  depends  only  on  ran>>e  K anti  h.  Kivariaif 
normal  distribution  of  an  impact  point  is  specified  bv  the  means  |i|  aiul  li 

of  horizontal  and  vertical  displacement  from  tlie  aiming  point  and  by  the 

corresponding  standard  deviations  o,  and  o . Tiius.  in  this  case  t lie  vulnei- 

h V 

ability  data  of  eacli  veliicle  depends  on  six  variables:  R,  , p,  , ii  , , 

li  v h 

and  o . 

V 

Vulnerability  data  witli  normal  distribution  are  availalile  tor  u,  = 

li 

= 0 and  - 10.5  k cm,  k = 1,2,...,  10.  Tliese  data  were  computetl 

for  three  APOS  i 1 5mm  rounds,  one  witli  a steel  penetr.itor,  anotlier  witli  tung- 
sten alloy  penetrator,  .tnd  tiie  tliird  an  exper  iment  ;i  1 round  witli  a stei‘1  peiie 
trator  but  witli  a sli^litly  lower  muzzle  velocity  tlian  llie  first  two.  Accord 
i nj;  to  tile  aiitliors  of  tliese  data  tlie  first  two  penelrators  produce  .ilmost 
identical  damage  and  tiie  third  becomes  comparable  to  tlie  first  two  it  tlie 
kill  probability  bv  this  round  at  ran^te  R is  compared  with  the  corresponding, 
kill  probability  by  tlie  otlier  rounds  at  ranp,e  R + 500  m.  Vii  1 lu-rat' i 1 i t v d.it.i 
for  the  round  with  a steel  penetr.itor  are  available  for  rti2  and  M551.  The 
tungsten  alloy  penetrator  was  evaluated  aytainst  an  MtiO  tank,  while  t lu'  d.ita 
for  the  experimental  round  .are  available  for  TIO,  TSA,  .and  PT7(i. 

The  data  contain  probabilities  of  kill  for  seven  values  of  the  aspect 
an^tle  raiiKlny;  from  0 to  IbO"  in  eciual  steps  of  U)''  tor  seven  v.alues  ol  r.iiini' 
from  500  to  1500  m in  steps  of  500  m.  O.at.a  for  the  exper  iment  .a  1 round  ,ire 
avail.able  for  r.an^es  from  0 to  1000  m except  for  PT7b  ilat.a  which  .ire  inilv  .it 
500  .ind  1000  ni.  We  call  these  data  the  first  set. 

The  second  set  of  vulnerability  d.at.a  contains  kill  prob.ab  i 1 i t v lor  six 

different  normal  distributions  of  the  impact  iioint  with  distribution  p.ira- 

meters  ( j , j « ’v' ’ ' ” ~ ’'hi  ” ‘'™>  li|,  > “ 

250  cm,  u,  , = 500  cm,  p , = - 15  cm,  p ,,  = 15  cm,  p , = 70  cm,  - 100  cm, 

111  vl  v2  vl  b 

,itid  - 110  cm.  These  values  were  seli'cted  as  ri'presi  nt  .at  ive  ol  simtil.iled 

tiriiic  results  diirinjt  the  ARSV  field  tests  The  second  set  contains  kill 
prob.ib  i 1 i t ies  corresponding,  to  each  of  thenine  distributions  for  the  s.ime 
sevi’ii  .ispect  .an,ules  as  the  first  set  .and  for  ran>;es  of  500,  1000,  2000, 

.and  1000  m.  I'liest*  d.at.a  are  the  kill  probabilities  for  MtiO.M,  TIO,  and  Tti.’ 
bv  till'  st.md.ard  115mm  round  with  a steel  penetrator. 

The  kill  prob.ibilitv  corresponding  to  a fixed  distribution,  aspect  .uip.le, 
.ind  r.me.e  depipuls  on  the  .amount  of  armi’r  as  well  as  other  variable's  such  .is 
number,  size,  Kicat  ion,  .ind  sensitivity  of  various  components,  includinv, 
crew,  .immiiii  i t ion,  I'tc.  The  six  vehicles  tor  which  vu  liu'rab  i 1 i t v data  are 
.iv.iil.ible  difter  <|u  i t e considerably  with  respect  to  these  clia  rac  t er  i st  i is  . 

We  note  th.it,  in  e.ener.al,  .armor  protection  is  proportional  to  the  .armcir 
weip.ht  .ind  that  tot.il  .armor  weight  of  fielded  combat  vehicles  constitutes 
ne.irlv  a fixed  percentage  of  their  e.ross  weight.  Thus,  other  thiiiRs  beiny, 
eipi.il,  kill  probability  should  be  an  antitonic  function  of  yross  weiyht. 

This  is  not  the  c.ise  with  the  available  vulnerability  data  because  ol  many 


DtluM'  V.I  i fft'ioiKi's  iH'siilos  iiniutr  i>rot  oct  ioii.  Wo  note,  that  for  a particu- 
lar pair  of  vohiclos  Jifforinn  cons iilorahly  in  lunount  of  armor  the  kill  proli- 
ahilit\  of  .I  loss  protootoii  vohiolo  is  smallor  at  aspect  angles  of  hO”  and 
ISO"  while  at  other  angles  of  attack  the  lighter  vehicle  is  more  vulner- 
ahle  as  should  he  expected.  The  situation  is  even  more  complicated  since 
at  a ('it'’  aspect  angle  the  heavier  vehicle  is  tougher  at  tOOO  and  .S.SOO  m 
r.inges  while  the  lighter  is  tougher  at  shorter  ranges.  In  the  case  of 
another  pair  of  vehicles  with  a stilt  larger  difference  in  gross  weight  the 
kill  proh.ihi I i t y of  the  lighter  vehicle  is  lower  than  that  for  the  heavier 
cine  at  a iH'''  angle  of  attack  from  a r.inge  of  J.'i(U)  ami  m while  for  all 

otlter  ranges  at  this  angle  of  attack  the  heavier  vehicle  is  tougher  than 
the  lighter  vehicle.  At  an  angle  of  dO"  the  kill  probability  of  the 
lighter  vehicle  in  this  pair  is  lower  than  that  of  the  heavier  one  for  all 
ranges . 


We  compare  kill  probabilities  with  uniform  distribution  of  the  imp.ict 
pi-lint  for  all  lli  pairs  of  the  six  vehicles,  'fhe  first  set  xields  St'O  pairs 
of  prob.ib  i 1 i t i es  with  tlu'  elements  of  each  pair  corres|Hind  i ng  to  the  same 
.ispect  angle  and  range.  Of  these  I .>('  j-iairs  show  that  the  conditional  kill 
prob.ibi I ity  of  a lighter  vehicle  is  smaller  than  the  corresponding  kill 
probabilitx'  of  a heavic''  one.  We  further  observe  that  for  certain  values 
of  range  and  aspect  angle  the  correlation  between  kilt  jirobabi 1 i ty  and  gross 
weight  is  positive,  i.e.  , in  general,  tlie  vu  1 nerab  i 1 i t >■  increases  as  we  pass 
toward  heavier  vehicles.  This  happens  at  a range  of  l.‘‘dlO  m .iiui  an  aspect 
angle  of  ISt'”  as  well  as  .it  a range  of  JOOO  m and  an  asjiect  angle  of  bO"  . 
rhe  kill  probabilitv  computed  with  normal  distribution  of  the  impact  point 
shows  ei|uall\  poor  correl.it  ion  with  aniior  weight.  I'or  instance,  three  cases 
specified  b>'  iinjiact  point  distribution  parameters  seven  asjH'ct  angles  and 
four  ranges  provide  So  sets  of  kilt  probabilities  for  three  vehicles.  If 
these  vehicles  differed  on  1 \-  in  armor  jirotection  each  of  the  .‘‘id  probabilitv 
sets  ordered  bv  the  corres|Hnul  i ng  vehicle  weiglit  would  consist  of  three 
monot on i ca 1 1 y decreasing  values.  However  we  observe  that  in  two  cases  out 
of  .'■'(I.  the  kill  probabilitv-  decreases  with  weight,  in  four  cases  it  is  an 
isotonic  function  of  weight,  while  in  the  remaining  .'’H''  cases  it  is  not 
monotone. 

('onsei|uent  1 V-  the  vu  1 nerab  i 1 i t v data  must  be  sipip  1 ement  ed  bv  certain 
assumptions  in  order  to  derive  suitable  formul.is  for  extrapolation  and 
int  erjvolat  ion  as  reipiired  for  comparing  relative  benefit  of  armor  )'ro- 
tection  and  mobilitv-  and  bv-  a studv-  of  other  trade-off  relations.  .'Simple 
monoton ic i t V is  the  I'asic  assumption  of  our  vu 1 nerab i 1 i t v model,  besides, 
we  assume  that  existing  vehicles  Ivecause  of  manv-  other  variable  parameters 
constitute  a random  sample  from  a family  of  vehicles  that  satisfy  monoton- 
i c i t V'  cond  i t i ons . 

.A.  Model  Assiimpt  ions 

l.et  w and  w'  be  the  weights  of  vehicles  ,\  and  b.  respect  i ve Iv  . We  sav 
that  b is  an  increment  of  A if  w'  - w .uul  b is  obt.iined  from  A bv  increasing 
armor  protection  at  varimis  locat  ions  v'i  \ aiul  by  modifying  its  structure, 
tracks,  suspension,  etc.,  to  accommodate  the  increased  annor  weight.  We 


also  say  that  vehicles  of  the  family  V are  of  compatible  tleslpn  if  for  every 
pair  A and  B in  V either  A is  an  Increment  of  B or  B is  an  increiiu'nt  of  A. 

We  note  that  the  increment  relation  is  transitive  and  a family  of  com- 
patible deslRn  can  be  obtained  by  starting  will)  an  optimal  desipn  of  a com- 
bat vehicle  and  construct  Ing  the  other  vehicles  by  succi-sslve  increast-s  <if 
the  amount  of  armor. 


Lot  p be  kill  probability  with  a fixed  distribution  of  the  impact  point 
computed  for  vehicles  of  compatible  desiRii.  Then  p is  an  antitonic  funct  it)n 
of  the  gross  weight  w for  every  range  R and  attack  angle  0.  We  assume  that 
it  is  an  analytic  function  of  w and  R: 

(1)  p = p (w,  r , 0 ) . 

The  antitonicity  implies 


(2)  U<(l. 


Since  we  consider  a kinetic  energy  round  we  also  have 


(1)  ^^0. 


We  assume  that  armored  combat  vehicles,  for  which  vu  1 lu'rab  i 1 i t v ilata 
are  available,  which  we  call  samiile  vehicles,  are  random  sampK's  from  ;i 
family  V that  contains  the  designs  from  a compatible  lamilv  V'  each  mollified 
by  a moder.ate  but  random  changi'  of  sensitive  components,  their  U'cation, 
ami  armor  distribution.  This  assumption  implii's  that  p (w,  R,  (0  is  t lu' 
mean  of  the  family  V.  Vherefore  it  can  be  estimated  by  a le.ist  sipiares 
fit  of  the  vulnerability  data  for  the  sample  vehicles. 

Since  the  hull  of  MSSI  is  aluminum  while  the  luills  of  all  otlu-r  samp  1 1' 
vel\icles  are  made  ot  steel  we  do  not  inclvule  this  vehicle  in  the  samplt'  from 
the  family  V.  The  vehicle  Tr7b  is  also  not  included  since  its  cri'w  consists 
of  onlv  three  men  while  heavier  vehicles  have  a crew  of  four.  However  we 
compare  the  data  of  MSSI  and  Pr7h  with  approximations  obtained  from  our 
mode  1 . 

We  express  kill  probability  p^^  = p (w,  R,  Ol  with  uniform  distribution 

of  the  impact  point  in  ti'rms  ot  a truncati'd  power  series  iu  w and  R and  use 
the  dat.a  for  a fixi’d  •'  in  a stepwise  multiple  regri-ssion  fit.  This  compu- 
tation shows  that  the  significant  terms  are  linear  in  R and  ipi.ulratic  in 
w,  i.e.,  we  get 

2 

{h)  p - a,  + a.,  R + (h.+b.-R)  w + (<■  +c,,R')  w*^ . 

' u 1 d Id  Id 


i.lC 


f- 


1 


( 


A dlrt’ct  least  squares  fit,  such  as  stepwise  multiple  reRressicin,  produces 
an  estimate  of  p (w,  R,  0)  tliat  does  not  satisfy  (2)  for  every  0 and  R or 
( 1)  for  every  0 and  w.  Tlierefore  the  conditions  (2)  and  (])  must  he  in- 
cluded as  constraints  in  tlie  least  squares  fit  of  tlie  data. 


Equation  (A)  is  .i  parabola  in  tlie  (w,  p^^)  plane.  Tlius,  condition  l 

can  be  satisfied  eitlier  by  a convex  or  concave  arc  of  a parabola.  A vljui.i! 
inspection  of  tlie  data  plots  suRRcsts  a concave  curve.  Therefore  we  ctumsi' 
a parabola  with  a positive  maximum  at  a non-positive  value  of  w,  l.e.,  we 
require  that 


(SI  a,  + a^  R ' 0. 
(bl  C|  + c.,  R ' 0. 


and 


(71 


2'(C|+c -.R)" 


^ 0. 


In  view  of  (b),  condition  (71  is  equivalent  to 


(S)  bj  + b.,  R »=»  (1. 


Conditions  (S'),  ttO,  and  (S’)  must  be  satisfied  for  everv  R of  interi'st.  We 
choose  the  values  of  R in  the  interval  between  (1  and  A km.  Vherelore  (bS  is 
equivalent  to 


(^)  aj  0 and 

(lOl  a^  + A a.,  ' 0. 


t'ondition  (b)  is  satisfied,  provided 

(11)  Cj  • tl  and 

(12)  Cj  + A c,  ■ 0. 

Simllarlv,  from  (S)  we  h.ive: 


(11)  bj  "S  0 and 

( I A ) b j + A b ^ t.  0 . 

Condition  (1)  implies  that  .i , + b,  w + c,  w'  0 fi'r  everv  w in  the  inteival 
of  interest,  sav,  in  |(1,  w |.  This  last  condition  is  satisfied  if 


bSl 


{ , 
f ' 


tis)  a,  •.  0, 


and 


(lb)  ' 0, 


(17)  a,,  + h,,  w + c„  0. 

7 z m 2 m 

Wo  soloot  w as  tho  rielu  ondpoint  of  tlio  intorval  in  wliioli  0 ^ P , i.o., 
m I ' n 

vj  is  dofinod  bv  a,  + 4 a,,  + (h,+4  b.,)  w + (c,+4  c.,)  w*”  = 0.  Sinco  (4)  is 

m 1 2 1 2 m 1 2 m 

antitonio  in  w and  R tbo  condition  p^  **  1 is  cqulvalonl  to 

(18)  a^  v;  1. 

Thus,  for  oacb  P wo  obtain  a loast  squares  fit  of  (4)  with  tbo  con- 

/V 

straints  (^)-(18)  with  *^(-1'  - ft'*  - 4aY)/2’»,  wbore  a “ '*)  ^ 

b * b|  +4  b.j  and  > = + 4 c.,.  This  defines  mobility  or  firepower  kill 

probability  (with  uniform  d istr  ibut  ii'n  of  tlu'  imiiact  point)  as  a function 

of  weipjit  w and  ranyte  R with  coefficients  as  tabular  lunctions  of  i’.  Tbo 

vulnerability  data  for  in'rmal  distribution  also  deviati's  fii'm  monotonicitv 

quite  considerably.  Tberefore  we  I'btain  a least  squares  tit  of  form  (4) 

witit  constraints  (d)-(18)  fi>r  eacb  *'  and  each  distribution  of  tin-  impact 

pv'int.  I'bese  fils  yield  an  approximation  to  eaclt  value  of  kill  I'robabilily 

in  tbo  second  set  I’f  data.  fbo  .ii'prox  imat  ion  v.ilues  obtained  tins  wav  are 

smoothed  v.ilues  that  possess  ibe  rt’quired  mcinotonic  itv.  Tbese  values  depend 

on  w,  R,  0,  .ind  tbo  impact  point  distribution  p.irameters,  u.  , u . , and 

' b V b 

, i.e.,  kill  probability  is  ,i  function  of  seven  variables.  Kxaminat ion 

v’f  t be  data  shows  tb.it  an  interpolation  formula  dependent  on  four  vari.ables 
iinlv  c.in  be  constructed  bv  considering  as  intermediate  v.iriables  tbe  kill 
prob.ibility  p^^  for  uniform  distribution  of  impact  point  wbicb  is  a function 

o!  w,  R.  and  P,  anil  bit  probability  ii,,  wbicb  is  a function  of  P,  , P , , 

• ' 2 ' 
w ' p"  + p- 
1^  V 

,ind  ' , tbe  quantity  r = — _ __  • ‘•'''‘f  test  tor  s i y;n  i f icance  ot 

V • Y 

1 + ► P,  + P 
b V 

v.irious  combin.it  ions  of  tbese  variabli's  le.uls  to  tbe  followiny;  approximation 
for  mobility  or  firepincer  kill  probability  p with  normal  distribution  of  tbe 
imp, let  point: 

'’k '11  ’ ''u  * ''’ll  ^ 

wbere  p is  piven  bv  (4).  Ibus  (l'*l  topetber  with  (41  constitute  our  para- 
metric lui  1 ner.ib  i 1 i t V model  or  .in  i nt  erpc' 1 at  i on-ext  rai'o  1 at  ion  procedure  in 
tbe  seven-d  imenst  ion.i  I sp.ice  of  vari.ibles:  w,  R,  l\  u , ii  ^ . Cj^.  and  ^ 


4.  Niimorio;jl  Results 


'(’he  proeeiiure  lieseribej  in  the  preeediiin  section  yields  extrii()oKit  ion- 
interpol.U  iiui  formulas  for  comput  lun  smoothed  values  p^^  of  mohility  or  fire* 

power  kill  prohahility  witli  uniform  d ist  r ihvit  iou  of  the  impact  point.  Because 
Ilf  tlie  imposed  monotonicitv  on  tl\e  approximation  by  equation  (4)  wliicii  is  not 
present  in  the  data,  the  discrepancy  between  smootlied  values  and  the  vulner- 
ability data  is  appreciable  in  some  cases.  The  root  mean  scpiare  of  this 
discrepancy  varies  between  0.02  and  O.lKi  depending:  on  tlie  aspect  an^le  d. 

The  largest  discrepancy  sllplitly  exceedlnjt  (1.1  is  at  0 = 11“,  R = l.b  km  and 
w = SO  tons.  t1ut  of  l‘)()  differences  between  ori>;inal  data  and  smootlied 
values  six  exceed  0.1.  According  to  our  formula  mobility  or  firepower  kill 
probability  tends  to  0.8^1  at  ran>;e  R = 0,  0 = 0 and  uniform  distribution  of  t lu 
inip.ict  [loint  .is  w >;in's  to  zero.  At  0 = ISO”  kill  prob.ibilitv  tends  to  0.S8. 

I'he  otlier  limit  in>;  values  of  kill  probability  are  between  0.(il  and  0.77.  We 
note  that  mobility  or  firepower  kill  probability  of  tlie  lii'.lit  vehicle  MSSl 
is  .;reatest  for  (1  = 0“  and  smallest  for  0 = ISO"  which  is  consistent  wltli 
our  model,  although  the  vu ! ner.ib  i I i t v d.ita  for  MSSl  wei'c  not  used  in  lieriviny 
the  approximation  for  p^^.  The  values  of  p^^  correspoiul  inp  to  w * 0 sugpest 

that  a hit  on  a vehicle  with  no  armor  produces  damape  with  the  preatest  pr<'b- 
abilitv  when  0 = 0“ , i.e.,  armor  protect  ion  is  most  important  for  this  direc- 
tion. oven  if  we  do  not  consider  that  a head-on  attack  is  more  likely  than 
f ri'm  other  directions.  dur  result  shows  that  on  the  .iverape  the  protected 
area  of  sensitive  comtionents compr ises  the  least  percentape  of  the  total  pro- 
jected are.'i  at  aspect  anples  of  (-1(1“  and  ISd"  (S^l"  and  SS",.,  respect  ivelvl  . 

The  approximations  for  p^  obtained  from  (41  ari'  compared  with  llu'  cor- 

respondinp  vulnerability  data  in  I'ipures  1-1.  Here  the  vulnerability  dat.i 
are  represented  bv  v.arious  symbols  with  line  sepments  joininp  t lu'  v.ilues  ol 
p cvmiputed  by  (41.  Both  the  liata  and  the  .approximations  are  rescaled  .and 

plotted  as  function  of  w for  various  vahu's  of  d as  shoimi  in  the  fipures. 

Kipure  2 presents  the  results  for  R = 1 km.  Vhe  other  two  pr.iplis  comp, ire 
the  d.ata  .and  the  model  for  R = 2 .ind  1 km.,  respectively.  Bec.iusi'  iM  the 
rescallnp  of  the  data  no  direct  comp.arison  of  these  pr.iphs  can  be  m.ide. 

We  .applieil  (41  with  the  ,iccom[i.any  i np  constraints  to  obt.iin  sraoothod 
values  of  vulnerability  ilata  with  norm.il  distributions  ot  the  imp.ict  point. 

The  RMSK  of  the  correspondinp  K'.ast  squ.ires  fits  ranpi's  from  0.001  to  il.IoJ 
dependinp  on  the  .ispect  .anple  and  the  imp.ict  pi'int  distribution.  Tort  un.it  e 1 \- , 
tlu'  rel.ativelv  l.arpe  d iscri'p.inc  ies  correspi'tid  to  I'xtremi-  me. in  v.ilues  ot  t lu- 
impact  point  d i sp  laci'ment  ,ind,  consequent  1 v , sm.ill  prob.ibilitv  of  hit.  I'heia’- 
fore  these  l.arpe  discrepancies  have  little  effect  on  the  pri'b.ab  i 1 i t v of  sur- 
vival p = 1 - P||  I'l^^ll  w’hich  is  the  ultim.ate  po.il  of  our  model  inp. 

The  smoothed  v.ilues  of  kill  probabilities  correspv'ud  inp  to  norm.il  dis- 
tribution of  till’  imp.ict  point  topother  with  the  valui’s  ot  p^^  determined  bv 

(41  are  used  to  computi’  t lu'  ciief  f ic  i ent  s ot  (I'll  bv  the  le.ist  squ.ires  nietliovi. 


FIGURE  2.  SCALED  VULNERABILITY  DATA  AS  A FUNCTION  OF  ''EIGHT  vs  TDEL 
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Since  onr  ^oal  is  p we  weight  bv  p in  the  least  square!«i,  t it<ing  ot  (1^>. 

Tlu'  rosu  1 1 in.i>  hios  of  coof  f ic  itipt  s A.  ‘h  , aw.1  C are  siniii  ftyeant  jt  a U-vel 
beUer  than  by  the  Student  t-test.  The  we IjS'iteJ' RMSK  of^this  t'it  is 

0.014  and  tlie  RMSE  of  withs>ut  weight  is  0.072.  A compa»' ison  of  ttiese 

two  errors  indicates  tiigit  larger  discrepancies  between  tlTl'  data  the  nn^di  I 

occur  mostly  in  the  cases  of  small  p . 

H 

Figures  4 and  .1  compare  tlie  values  of  p^^  Og/U  '»'ith  t tiiis« 

obtained  from  our  model.  Again  the  vulnerability  data  an4  approximjit iohs 
are  rescaU'd  for  these  plots.  Figure  5 sliows  tl»e  resiilts  of  tiie  heavier 
ve,liitle  and  Figure  b compares  tlie  •data  of  the  lighter  one.  The  resc.iled 
values'of  p,,  n,.  are  plotted  as  functions  of  the  aspect  angle.  Diffcr\'nt 

the  iWta  tor  ranges'  of  U(  2,  and  J .1^.  me  line  segments 


resc.i  1 ed 
Di  f f cr\'nt 


t'i  i'  iviiivv.iv.tiir>  v>i  vttv  vir>^>vv.v 

H K/M  ■<  ^ ^ 

symbols  represent  the  iWta  for  range.s'  of  U(  2,  and  J .1^.  iTi'e  line  segments 
join  the  correspondingly  rescaled  values  obtained  from  our  model.  Because 
of  the  rescaling,  these  figures  provide  only  informat  ion . about  the  trend  vif 
the  model  any  no  inference  about  the  relative  magnitude  of  the  differenci'S 
between  vulneralri  1 itv  data  and  our 'approx  imat ion  can  be  made.  chilv  the 
RMSK's  quoted.. above  can  be  usejl  compare  the  data  and  the  values  I'btaincii 
f rom  t he  mode  1 . , 
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FIGURE  4..  SCALED  VULNERABILITY  DATA  AS  A FUNCTION  OF 

ASPECT  ANGLE  vs  MODEL 
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riio  Tbcator  Nncloar  Force  Surv  i vab  i 1 i t v (TNF/S)  RMl  I’ropram  has  been 
ostablisbej  to  invest  ip, ate  the  survivability  iif  theater  nuclear  forces. 
Tlu'  ohjective  of  this  program  is  to  improve  the  survivabl I i tv  of  theater 
nuclear  forces  through  changes  in  operations,  iloitrine,  tactics,  organi- 
zation, anil  materiel.  In  support  of  this  effort,  the  Tactical  Nuclear 
K.irtare  Branch  of  the  llarrv  Oiamoiul  l.ahor.ator ies  is  lieveloping  a methoilo- 
logy  that  allows  existing  vu I nerab i I i ty/surv i vah i I i t v information  to  be 
presenteii  in  .a  small  unit  vulnerability  assessment  format.  This  approach 
atliiresses  .i  neeil  expresseil  by  w.argamers  for  simpler  numbers  as  input  to 
their  games,  e.g.,  the  integration  of  small  unit  vulnerability  data  into 
larger  assessment  routines.  This  paper  describes  the  methods  developed 
to  d.ite  and  gives,  as  an  example,  selected  results  of  a personnel  sur- 
vivability .'issessraent  for  the  Field  Artillery  Battery,  1 1")  mm,  Self- 
I’ropelled,  in  .i  nucliMr  engagement. 

We  h.ive  lound  that  cumul.ative  logarithmic  norm.il  distributions  of 
I'foper 1 v-se I ec t ed  environmental  parameters  describe  the  probability  of 
surviv.il  of  .1  t.ictic.ally  deployed  unit.  Azimuth.il  vari.it  ions  in  vul- 
ner.il'i  i 1 i t v of  tin'  unit  can  be  made  lu'gligible  bv  proper  selection  of  a 
set  ot  unit  deployment  area  reference  coord i n.it es . 

lniti.il  work  h.is  consisted  of  determining  mathematical  descriptors 
ol  nucle.ir  vu  1 ner.ib  i 1 i t v for  the  IIS  mm  Field  Artillery  Firing  Battery 
di'ploved  in  t.ictic.il.  st.iging,  .ind  road  m.irch  configurations.  Initial 
results  ot  this  ettort  indic.ite  that  on  1 v two  constants,  the  nu’.in  of  .i 
log.irithmic  norm.il  distribution  .ind  the  st.indard  deviation,  .ire  required 
to  describe  the  vu  1 lU'r.ib  i 1 i t v of  the  units  in  tactic.il  .and  staring 
.ire. IS  tor  e.ich  nucle.ir  environment.  In  effect,  the  unit  h.as  been  col- 
l.q'si'd  into  .1  I'oint  t.irget.  ITie  road  m.irch  conf  igur.it  ion,  which  is  in 
ellect  .1  one  d i mi'iis  i on.i  1 .irr.av,  requires  the  spi'c  i f i c.it  i on  of  vulner.i- 
bllitv  descriptors  .it  1 points  along  the  array.  Future  work  will  consist 
ot  determining  m.it  hi'n.it  i c.i  1 descriptors  of  nuclear  vulnerability  tor 
.iddition.il  units  ot  the  the.iter  nucle.ir  force.  This  inform.it  ion  will 
t.icilit.ite  the  t.isk  ot  i nvi'St  i g.i  t i ng  the  surv  i v.ib  i 1 i t v of  theater 
nucle.ir  forces  during  conduct  of  tactic.il  nuclear  warf.are  studies. 
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1 . Int  roduct ion 

Wargames  that  are  aggregated  at  higher  levels  (division  and  above) 
tend  to  wash  out  the  significant  factors  concerning  force  posture  that 
are  apparent  at  lower  levels.  It  is  at  these  lower  levels  that  improve- 
ments in  tactics  and  doctrine  become  evident.  Most  often  this  failure 
of  lower  level  assessments  to  impact  slgnif leant Iv  on  the  outcome  of 
theater  level  analyses  results  from  inadequacies  in  the  model  rather 
than  from  the  lack  of  importance  of  the  identified  vulnerabilities. 

In  support  of  the  Department  of  Army  (DA)  Theater  Nuclear  Force 
Survivability  (TNF/S)  program,  we  have  developed  a method  that  inte- 
grates existing  data  on  personnel  and  materiel  survivability  into 
assessments  of  the  survivability  of  small  tactical  units.  This  approach 
greatly  simplifies  the  data  input  into  higher  level  wargames  and  sig- 
nificantly reduces  computer  running  times  for  large  tactical  assessment 
programs.  This  paper  describes  the  method  and  gives,  as  an  example, 
results  of  a personnel  survivability  assessment  for  the  Field  Artillery 
Battery  155  mm,  Self-Propelled  in  a nuclear  weapons  effects  (NWE)  en- 
vironment . 

The  survivability  of  a small  tactical  unit  is  highly  dependent  on 
parameters  such  as  deployment  configuration,  unit  posture  (protected 
versus  unprotected),  and  materiel  hardness  (unhardened  versus  hardened). 
Since  these  factors,  particularly  for  small  tactical  units,  ran  vary 
over  a wide  range  , the  NWE  environment  level  required  to  render  a unit 
ineffective  can  vary  over  a wide  range.  It  was  a goal  of  this  effort 
to  assess  the  unit's  survival  probability  taking  these  factors  into 
;irronnt . 

The  method  described  in  this  paper  is  probabilistic  and  expresses 
the  survivability  of  a small  tactical  unit  as  a fraction.  We  have 
found  that  cumulative  logarithmic  normal  (CLN)  functions  of  properlv 
selected  environmental  parameters  describe  the  small  unit  survival 
probability  for  units  in  tactical  deployment,  in  staging  areas,  and 
on  road  march.  For  the  units  tactically  deployed  and  in  staging  areas, 
the  log  normal  function  describes  the  probability  of  survival  so  well 
that  the  unit  can  be  considered  a point  target  at  a proper  selection 
of  reference  coordinates  within  the  unit  area. 

The  method,  although  probabilistic  in  approach,  differs  from  both 
"cookie-cutter"  approaches  and  other  probabilistic  approaclies  which 
average  over  the  area  of  each  affected  unit.  Further,  tlie  method  is 
applicable  for  determining  personnel,  electronic  and  communication 
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i'<iu  i pini'iif  , wlu'olt'tl  ;in(.l  t r.uki’it  vi'hivU's,  :\inl  \'t  lu'i  s\ii  v i v.il>  i 1 i t ics. 
SiHtiiMi  J of  lliis  n.ii'tT  i>nt  linos  t Ito  st  o|'s  ro<|ii  i ii  <1  lor  .in  .issi'ssmonl  . 
Sov’tii'ii  1 it  i si'iissi's  t ho  r.it  i lUi.i  I os  t i>r  soli'it  i n>',  h.isolino  unit  posit  ion 
iirons  iisi'il  for  I ho  .issossnu'Ht  s . Soolion  i dol.iils  r ho  nut  hoilo  I iip,  v 
■ iiul  iiU-nt  i t ios  limitalions  whovo  s i p.n  i 1 i i ;inl  . Si-otions  S , i>,  7,  aiul  H 
ilisoiiss  t h»>  analvsos  for  t ho  various  lont  ij'aital  ions  aiul  units  invost  i- 
>;at  Oil  in  this  stmlv.  I’inallv.  si-ot  ion  '<  v.ivi's  si  ml\  tosnlls  .mil  J i s- 
oiissi's  s ip.n  i f ioant  oono  Ins  ions. 

J.  .Xj'proaoh 

riio  first  stop  in  t ho  oomlnot  ol  .i  sni.i  I I unit  sn  rv  i v.ih  i 1 i t v .o.-a  -.s- 
mont  is  t ho  solootion  ol  ,in  .ipp  ropr  i .i  I o unit  lor  si  n.lv  . Iho  soi  on.l  .lop 
is  to  iilontitv  a st.inil.itil  hop  lov  wont  l.ivovit  ol  t ho  nnil  . i iii  I mi  i np 

m i ss  ion-or  i t i 0.1 1 ni.itoriol  .uni  porsonnol.  \oxl  . nm  lo.ir  vn  I nor.tl' i I i i v 

il.it. I aro  olit.iinoil  tor  l lio  ni.itoriol  .iiul  porsonnol  so  ih.il  l ho  sonsii  i \- i i ic 
to  tlo)i  1 ovniont  .spooitio.s  (o.p..,  loo, it  ion  ot  I'orsonnol  .iiul  wo.ipons)  , .in 

h»'  ili’t  orm  i noil . I’in.illv,  t ho  opnipnionl  .nnl  poisonnol  vn  1 not  .ih  i 1 i i iis 

• iro  .in.ilvpoil  on  ,i  sm.ill  imil  h.isis  to  (I)  ihoiitilv  t lu  iiiiw.il 
vn  1 nor.ih  i I i I i I's  , (J)  spoo  i fv  vn  I no  r.ih  i I i l v t oilin  i ion  rto.i  sn  i i s , .mh 
t I")  proviilo  sni.t  1 I nnil  inputs  to  t.iolio.il  nnolo.it  w.ii  f.iiiicv. . 

.A/,  ir.int  h,i  1 v.l  r i .it  i oils  in  vn  I nor.ih  i I i l >,  ot  i ho  t.utii-.il  unit  lot  iMoh 
onv  i roniiioti  I o.in  ho  m.iilo  nor.Iipihlo  hv  propor  soloot  ion  ol  .i  sot  oi 
r o I i’ t on  oo  ooo rJ  i n.i  t I's  , o.i  I I oh  l ho  nnil  " vn  I no  t .ih  i I i l \ . o n l o i " ( \ i I 

tor  th.it  nnolo.ir  ol  I o.  t . I'hns  two  oon.t.mis,  t ho  no, in  oi  i i I \ ,1  i s- 

trihution  .iiul  its  st.inh.irh  hovi.ilion,  iro  loipiiioh  to  his.-rih.-  tin 
vn  1 no  r.ih  i I i 1 V o I .i  nn  i t lor  o.ioh  onv  i i onnion  l . In  o I t o.  i , tin-  nnil 

h.is  hooll  ooll.ipsoh  into  .i  sitii’.lo  t'oint  l.ilo.ol.  lor  Iho  i o.ih  r.ir.h, 

u'h  i oh  is  .1  1 i no.  1 r . 1 1 1. 1 v , wo  li.  i vo  ' on  ml  I li,  1 1 t ho  nnil  n i \ ho  i o 1 I i n si  h 

i nt  o t hi  oo  po  i nt  t .it  p.ot  . 

In  .ihh  i I I on  I o w.  1 1 nil  i 11 , iho  .sn.i  1 I - nn  i I sn  i v i v.  i h i 1 i t v . i ssos  siiu  m I 

iiio  I hoho  1 opv  o.in  ho  nsoh  lo  porforn  .sons  i i i \- i i \ sinhii's.  .Smh  siuhios 

vi'ri'  pi'i'l  ornoh  on  Iho  l>i  mii:  h.itloia  ii'  oonp.ito  unit  snt  i v.ih  i 1 i I i os 
I'l  t ho  t.iolio.il  ho|>lovnont  vorsns  tin-  si.n-ino.  .iro.i.  V.'o  won  .ihio  to 
ipi.  in  I i I v I ho  .s  i on  i I i 0.1  111’  os  o I s!i  i o 1 h i no,  . inh  h i spo  r s i on  lor  unit 
siirvi  v.ih  i I il  V on  Iho  nnoIi.,ii  h.ittliliolh  lor  tin  |ii  nn  h.iitoiv 
I .10  I i 0.1 1 1 V ho|'  I ovoh  . 

'.  I'si.ihl  ishnont  ot  ll.isvMno  I nit  l’osiii,.n  .\ro.i 

Vn  1 nor.ih  i 1 i I \ .issossni ’n  1 of  .ito.i  t vp,  i.iro.its  loins  .i  n.iti  ,,|  m.inv 
onrroni  nnolo.ir  h.in.ip.o  .issossmoni  nolhohs  ih.it  ito  onp|ov,,|  in  Hop.in- 
ni  o n 1 o t 1 1 1 ’ t o n s o ( I H i ' 1 1 . i r l . i r o - r o 1 a t o h o o h o s . in  . i s n r v i ■ v o 1 t n r t o n 1 

‘Olios  ( t o I . II,  t hi ' . 1 1 1 1 ho  r . i 1 o ,s  I'll  ■ f hoh  s I Tip  I o voh  i n r i i ‘i  t I \ in  o h,  i r . lo 
t of  i ,Mt  i on  o!  oxtoiiiioii  1 .iroa  t s ,is  woll  .o,  oi  hi  r .sn,.,  ili,  .no. is  snoh  ,is 
t ho  St  ,it  o ot  tho  .irl  in  t.irp.it  .inh  wo  ipon  hop  I omtioii  t , nm  1 o.i  r- i nhnooh 
onv  i ronftoni  s , "fopor  nso  o‘  t .irool  vn  1 not  ih  i 1 i t v h..u  .i . spo.  itio  h.ini,i)>o 

o.i  1 on  I .It  i .’P  t oolm  i<;iios  , ami  output  o.ip.ih  i 1 i t i os  . Ip  tho  i ohos  .issossoh, 

oxt  onhi'h  l.iroots  .If,  ooiioimIIv  roprosontoh  is  ,i  t i xoh  tti.i  l hon.i  t i i ,i  I 
li  i s t r i hii  1 i on  ot  point  t iroots  within  tho  .iro.i,  whioh  is  .issniroh  to  h.ivo 


.1  Hi'iMWi't  r i i'  sli.ii'i-,  i' 1 1 ipt  i i-a  1 or  ri‘ct  .nip,ii  1 ar  . 

lo.oil  ilv'Si  I i I'l  i oils  imliulo  a iiiiit'orni  il  i st  r i but  ion  throughout 
I'i'iiit  t.it,i.’,ots  at  t lio  I'liriuTs  aiui  at  I iio  rontiT  of  t Ito  aroa, 
iH'imal  il  i St  r i hut  i oil  ol  targots  atuuit  a point. 


Common 1 v 
t ho  aroa, 
.iiul  a 


rill'  aotu.il  il  i st  r i hii  t i on  ol  piM'somu  1 and  oipiipmont  in  taotioal 

• iro.i  tarpa'ts  is  suoli  that  t I'w  (it  anv)  of  t lusso  tai'nots  i-an  ho  oliarao- 
toi  i.'oil  .IS  loiu  a i 11  i 11)',  porsonnol  and  ispiipmont  distrihut  ion  wliioli  lan 
ho  oxprossoil  hv  .1  t ixi'il  iiiatliom.it  io.il  oxprossion.  I'.iot  io.il  tai'ttots 

• iro  Ilia  i n 1 V nonuii  i t o rm  1 v d i st  r i hut  o<l  piiint  taipa'ts  ot  v.irvinp,  vulnor- 
.il'ilitv  aiul  t.iri’a't  valuo.  riu'rot'oro,  to  m.iximizo  t lio  aooiiraov  of  t lii' 
surv  i vah  i I i t v assossnionl  of  .in  a ri'.i  ' t a rgi-t  . il.ini.iKo  i-a  I I'u  I a t i ons  .iro 
portornu-d  on  i po  i nt -hy-po  i nt  liasis.  Kor  .inv  rop  rosont  at  i vo  hattli'- 

t iold  su  rv  iv.ili  i 1 i t V .issossnion  t , sin  li  .i  proii'duri'  would  hi-  i-xtronu-ly 
ti'dioiis  and  timo  oonsiim  i n>; . I'hoso  jirohloms  proiiiptod  our  offort  to 
roprosont  a ivpio.il  taot  ioal  oolioront  unit  as  an  id'toi'tivo  (loint  tar^’ot, 
till'  vu  I iior.ih  1 I i t V ot  I ho  unit  hoinit  dotorniinod  front  t ho  v'li  1 lu-rali  i 1 i t i os 
ot  o.ii  h poison  ,itid  o.ti  h pUs  i'  ot  oipiil'iiiont  in  t ho  unit  . 

fo  porlorm  .i  iiuoloar  vu  I lU'r.ih  i I i t v assossniont  of  a siioo  i f i o taotioal 
unit,  a roprosontal  ivo  oon  f i pu  r.il  i on  ol  oi|uipmont  and  porsoniu-l  oon- 
1 1 »;ur,it  i ons  must  first  ho  dotinod.  Sinoo  t ho  Niiolo.ir  Kill  .‘^uhp  roR  r.nii 
ot  i'Nf'/S  was  add  ross  i np  t ho  vu  I tiorah  i I i l v ol  t ho  1 h'l  mm  hattorv  ,is  its 
i It  i I ial  I'lfort  , a ti'p  roson  l at  ivo  hisio  ooni  ipural  ion  for  this  unit  was 
oht  .1  i nod  . 

Koforonoo  d.ita  rolativo  to  orpaii  i .Mt  ioit , oiiuipmont,  doplovmont,  and 
t. loti  os  ol  ,1  I'll  mm  hattorv  (rot.  and  aio  oht  a i nod  I rom  t ho  I'.S. 

Armv  VioUl  .■\rtillorv  Sohool  at  ft.  Sill,  t'ki.ihoma.  'loro  spooifio  intor- 
m.it  ion  rol.il  ivo  to  t ho  posit  ion  aroa  was  ohtaiiu'd  hv  vorhal  oommunioal  ion 
with  iitformod  si'ooialists  in  this  .iroa  at  I't  . Sill  and  l ho  I'.S.  Arniv 
M.itoriol  Svstoms  Anaivsis  Ao.oiu'v  ( AMSAA)  . litis  i nt  ormat  ii'ii  was  usod 
to  p.onor.il  o lip,.  I,  wliioli  shows  t ho  loo, it  ion  of  oouipmoiit  ,uid  porsonnol 
in  ,1  tvpiiMl  t.iotio,il  position  ,iro.i.  In  li,P.  1,  t ho  dist.inoo  hotwoiui 
fl,ink  liowit.-ots  is  JllOm.  I'oplovnionl  lons  i dor,it  i ons  m,iv  inoro,iso  this  dis- 
t.inoo up  to  A it'i'i  or  dooi  o.tso  it  to  T'Orn.  I'ho  pl.ioomont  ol  i ho  sniiport - 
i np,  soot  ions  with  rospool  to  t ho  howit.’ors  is  rodiiood  iir  inoro.isod 
proport  i on.it  o 1 v . 


riio  Ivpio.il  position  .iro.i  in  t ho  h.iltorv  spooitios  t vno  ind 
t ion  ot  o.ioh  I'oliiolo.  r.ulio,  .ind  porson.  rorsonnol  .iro  snooil  io 
oithor  onlislod  nioii  who  porlorm  spooilio  opor.ition.il  Innotions  o 
ol  t i oors -soo  t ion  oliiols  who  ,iro  oomi'ot  out  in  .ill  .iro, is  orit  io.il 
por  t orm.ino  o ot  t lu'  h.ittori  l.iot  io.il  mission.  llio  h.ittorv  oonsis 
six  liowil.'ors  .iiul  .issooi.itod  .inimiin  i t ion  i-.iirior.-..  .i  tiro  diroot  i 
oont  rol  oont  or  tri'i't,  .i  h.ittorv  oj'or. it  i ons  oontoi  tr'iH"i.  ,i  n.iint 
soot  ion  ('I.NlNff,  ,i  moss  soot  ii'ii,  .i  oi'mmun  i o.it  ions  siot  ion,  .ind  .i 
soot  ion.  riio  h.ittorv  .mmunit  ion  soot  ion  is  in  t ho  h.iltor\  posit 
.iro.i  .ipprox  im.it  o 1 V .’l'  to  i poroont  ot  i ho  timo  dniinr,  .i  t.iotio.i 
di't'lovmont  . rorsonnol  in  t ho  liovi  i t .'ors  ,ind  t ho  ( omm.iiul  i.irrior 


.iro  .issumod  to  ho  .iltordod  t Ito  shioldiiu', 
porsonnol  iro  oonsidorod  to  ho  i'X|'osod. 
to  ho  in  tl.it  torr.iin  tor  this  .in.ilvsis. 


ot  t lioso  voh  i 0 I os . All 
fill'  pos  i t i on  ,1  t o I w.ts  ,1 
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Figure  1 . Fiela  Artillery  Battery  1 55MM  Self  Propelled. 


Surv  i v.ilu  I i t V Assi'ssm.'ii t Mi't  lioil 


Oiu'i'  I III'  S111.1 1 I -im  i I posit  inn  ,iroa  li.is  lioon  ost  ab  I i shod  , t lie  first 

stop  in  t lio  unit  surv  i vah  i 1 i t v assossmont  is  to  iivor  1 ay  t lio  aroa  with 

a ri‘o  t aiut  1 i'  and  t ako  t lio  iti'oinot  r i o oi'iifor  as  a rot  oronoo  point. 

I'lio  soooiul  St  I'p  is  to  siiooifv  t lio  ntioloar  onvironmont  hv  us  i n^  an 
oxprossion  wliioli  pivos  t ho  nuoU'ar  miv  i ronmont  lovol  as  a lunotion  I’t 

Wi'api'n  viold  and  ranpa'  t loni  aotu.il  p.ronnd  ;'oro  (ACZ)  . Wi-  uso  t ho 

I'liv  i ronniiMit -d  i St  anoo  a 1 i t lims  lor  t hi'  various  nuoloar  onvironmonts 
j’.ivi'u  in  rol  . 'i . Third,  t ho  vu  1 norah  i 1 i t y of  I'aoli  (lorson  or  oiiuipmont 
is  dosoril'od  in  toms  ol  I lio  nuoloar  onvironnionl  undor  oons  idi'tat  ion . 
t'ur  lonmilat  ion  usos  two  nunilH'rs: 

I'lio  natural  1 ov’.a  r i t lim  of  that  valuo  of  t ho  inoidont  Ifi-o- 
f i i' I d I'liv  i ronmont  that  rosults  in  a hO  poroont  prohahilitv  ot 
a spooil  i od  lovol  ol  porsonnol  inoapaoitat  ion  or  ot  oipiipniont 
daniaj’.o . 


rho  standard  distribution  of  i noapao  i t at  i on  or  dama)to 
prohahilitv  about  this  moan. 

rho  I oil  It  li  stop  sols  I ho  r.iuitos  ol  intorost  hv  (If  .issnniiny,  .a 
wo.ipon  v i i' I d .ind  l lion  ( .’ f I i ml  i ny,  (ho  ilisl.imos  I roni  t ho  rot  oronoo 
point  to  .Mf's  on  .i  r.idi.il.  Thoso  disl.inoos  j’.ivo  p roh.ih  i I i l i os  hotwoon 
roui'.h  I V I'.il)  .ind  tl.''T  ol  surviv.il  ol  I ho  olorionls  ol  I ho  posit  ion  aro.i. 
This  r.inp.i'  is  shown  sohoiii.il  ii'.illv  in  T i p. . . ll  is  I lion  hrokon  into-  .i 

ri'.isi'n.ih  1 1'  nuiiihi'r  ot  .Vi','  Ioo.it  ions  (in-ui.illv  Id).  lor  o.n'h  .)(-  lUi  a 
r.idi.il,  t ho  proh.ihilitv  ot  surviv.il  of  o.ioh  i t om  within  t ho  position 
.1  ro.i  ( r . ) is  0.1  loul.it  od  hv 


whoro  T is  t ho  onvironmont  lovol  it  th.it  point  . 'I  l ho  1 o)'..i  r i t hia  ol  tho 
onv  i roniiii'ii  t lovol  roipiirod  loi  'M'  poroont  proh.ihilitv  ot  oK'iiiont  sur- 
viv.il,  .ind  is  tho  si  .md.ird  do\’i.iijon  ol  tho  I’lN'  .1  i si  i i Inil  i on . Inil 
surviv.il  proh.ihilitv  is  o.iloul.ilod  t roiv  tho  iiulividii.il  survi'.’.il  nr.'h.i- 
hilit  ios  of  o.ioh  i I om . II  .ill  i t oms  h.ivo  t lio  s.ii-'o  irnpoi  t .inv'o  (woio.ht  ) 
lor  .looonip  I i shmont  ol  tho  unit  mission,  t hon  tho  .ivor.io.o  surviv.il 
proh.ihilitv  ot  till'  unit  (!'  ^ duo  to  .i  doton.it  ion  is  o.ivon  h\ 
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whoro  N is  tin'  numhor  ol  i t oms  in  tho  unit  . .\  pro. it  or  woiplit  o.in  ho 

asslpnod  to  anv  i I om  hv  .issiim'ip.  moro  of  (his  i t om  .it  its  loo.it  ion  iiilhin 
tho  ari-a.  Kor  i-x.implo.  .in  of  t i oor /soot  i on  ohiot  nip.hl  ho  oonsidorod. 
as  two  porsonnol  hoo.iiiso  l lio  ottioor  o.in  suhstitiito  .is  m onlisto.i  ran 
in  ,an  omorponov.  llowovor,  this  woiplit  i np  w.is  not  dono  in  ihi-i  .in.ilvsi-.. 


Figure  2.  Survivability  Assessment  of  a Small  Tactical  Unit. 


Unit  snrvivcil  iirob.ih  i 1 i t i i>s  ,u<>  oht  ,i  i noil  simil.irlv  ti>r  .ill  .Vlii 
liH';U  ions  ,ilon",  this  raili.il  .iiul  lor  .1111111  ion.il  r.uli.il;;  in  I'livclopt' 
t ho  unit  position  .itiM.  I'ho  \’C , .issiiPu'U  to  ho  t ho  pa'onio  t t i o oont  or  in 

tho  tirst  iti'r.ition,  is  t hon  ti’ I oo.it  oil , .iiul  t hi'  prooi-ss  is  rotio.it  oil  no  (t 

a point  is  I otnui  .ihout  whioh  t horo  is  .i:’ inint  h.i  I svmriotrv  ot  unit  snrviv  il 
probah i 1 i t v . 

Siniilarlv,  unit  snrv  i v.ih  i I i t v is  .issossoJ  lot  ol  hot  wi'.ition  vioM-.. 

A lo.ist  siinari'.s  I it  ol  I'  as  .i  t'l  N t unol  ion  iil  .i  tnu  lo.iv  ottv  i vi’ninont 
I'ar.inu'tor  is  ilono  lor  o.ioh  v i o I d . I'ho  nii'.ins  .ind  st.ind.ird  di'vi.it  ions 
aro  oloso  i.‘noii^h  in  v.ilm-  so  th.it  vii'Ul  o.in  bo  olimin.itod  bv  usinp, 

V. linos  woi>;htod  bv  tin.'  invorso  sipi.'ros  ot  tho  )itoh.ih!o  orrors  in  tho 
oa  I on  I at  i I'n.s  tor  oaoh  viild.  I'lu'  rosnlt  ol  this  o. tlonl.it  ion  is  two 
constants,  tho  moan  and  tho  st.ind.ird  lU'vi.ilion  ot  a I'lN  d i st  r i tnit  i on  , 

whioh  dosoribo  tho  snrv  i v.ib  i 1 i t v of  ;i  sm.i  1 1 unit  lor  .i  p.irtionl.ir 

nno loar  onv i ronraont  . 


Snrv  i v.ib  i 1 i t _v  An.ilvsis  iif  I'.io  I i o.i  I 1 v hoplovod  I’n  i I s 

Uonor.illv.  sn  rv  i v.ib  i 1 i l v .nt.ilvsos  .iltompi  to  oonsidor  .ill  N'Wr; 
bl.ist,  total  nnolo.ir  r.idi.ition  doso  to  pi'f.sonnol,  Ihoti'i.il,  ir.insiont 
r.idi.ition  oflivts  on  olootronios  (IKbbl,  .ind  both  low-  .ind  hic.h-.ilt  i l ndo 
o 1 oot  ron.ifpiot  i o pnlso  (IIMI’).  tiowovor,  for  spooilio  oi|nipmonls  .ind 
pofsonnol  in  tho  position  aro.i,  tho  ordor  .ind  docroo  ot  dot.iil  ot  tho 
.in.ilvsos  roqniro  prinoi(i.il  oons  i dor.i  t i on  ol  t hoso  onv  i ronmont  s whioh 
doniin.ito  tho  snrv  i v.ib  i I i i v ol  l lio  i t om  ot  inloro.st.  Ihns,  tho  NUT 
oonsidofi'd  in  tho  .inalvsis  of  tin'  sm.i  1 1 units  oonsidori'd  wofi'  nnolo.ir 
r.idi.ition  doso  to  porsonnol,  nont  ron  lluonoi-  off,'ots  on  r.idios  .ind 
rol.it  od  oqnipmont,  ,ind  bl.ist  offoots  on  vohiolos. 

S.l  Sn  rv  i v.ibij  i tj.-  of  I’orsonno!  t_o  Nnoloar  R.idi.ition  I'l  loots 

.\  o.isn.iltv  oviti'Cion  tor  a spiooifio  NV.T  ii.ir.imot  oi  is  th.il 
lovol  .It  whioh  t hi'ro  is  .i  St'  poroont  prob.ibilitv  th.it  .in  oxposod  porson 
is  nnablo  to  portoii.!  his  .issipnod  t.isk.  b.ittorv  pi'csininol  .iro  vnlnor- 
.iblo  to  blast,  therm. il,  .ind  nnolo.ir  r.idi.ition  oltool-,  .ind  thoir  snr- 
viv.ibilitv  ditti'i's  t<'r  o.ioh  oMoot.  Nnolo.ir  r.idi.ition  is  tho  onviron- 
monl  whioh  sooris  to  domin.it  o porsonnol  sn  rv  i v.ib  i 1 i i v . 


R.idi.ition  iMsn.iltv  oritori.i  lor  porsonnol  h.is  boon  snooifiod 
bv  tho  I .S.  Arpiv  Nnolo.ir  .iconov  (rol  . ■'  .ind  nl.  I'ho  npru'r  bound  fi'i' 

r.idi.ition  loi'ol  tor  pirsomiol  i no.ip.io  i t .i  t i on  is  tho  lovol  rt'iinirod  tor 
imrii'd  1 .1 1 I'  porninoiit  ili’l  iiio.ip.io  i i .it  ion  ot  porsonnol.  U’hon  oxposi'd  to 
this  l.'V,  1.  h.i  I t tho  porsonnol  I'ooomo  ino.ipa,  it.uod  within  S min  of 

I XiP'siiro  .ind  ron. lip  i no. i|).io  i t .it  od  for  anv  t.isk  until  doath.  I'ho  r.ulia- 

tion  lovol  oansiii.o,  innodi.ito  i noap.io  i t .i  t i on  ot  ■Si'  "oi  oont  of  tho  porsonnol 

porf.'rninc.  phvsii.illv  dom.ind  i n,i’,  (Il’lH  t.isks  is  p,ivon  as  tho  next  hiphost 

-.1 'ii.i  1 1 v-p  rodno  i no.  dos.-  |i\-,.|. 


no , 


I'tu'  rot  o I's  ,i  1 si'  o i t o radi.it  \oi\  lovi-ls  roquirod  tor  U's.'^ 
sovori'  lovol.s  ot  ino.ii'.io  it  ,ii  ii'n.  1 mnu'd  i .1 1 o tr.in.siont  (ID  i noapao  i t at  i on 
fi-tors  to  till'  St  .It  o ot  i no.ip.u- i t .It  ii'ii  in  wli  i ill  h.ilt  1 lu'  porsoniu'l  boiotno 
i lU'.ip.io  i t .it  I'd  within  S min  ot  t'xposnro  .ind  rt'ni.i  i n so  tor  !0  to  .'iS  min. 
I’l'rsoniu'l  rooovor,  hut  .iro  tunrt  ion.i  I 1 v imp.iirod  until  do.it  h (wliioh 
Oii'urs  in  s to  ti  il.iv.s).  Doso  li>vt“ls  .iii'  >;ivi’n  lor  undi'm.ind  i ng  (ITIM 
.IS  wo  1 1 .IS  dom.indinp,  (III’)  t.isks. 

I'lio  lo.ist  sovofi’  lovol  ol  inoap.io  i t .It  i on  is  i ormod  "l.iront 
loth.ilitv."  This  lovol  ot  i no.ip.io  i t .it  i on  is  oh.ir.ut  or  i 7od  hv  norsonnol 
hooomin;’,  t unot  ion.i  1 I v imp.iirod  within  d hr  ot  oxposuro,  t ho  m.ijoritv  of 
tho  oxposod  porsonnol  ii'm.iinin.n  t uno  t i on.i  1 1 v imp.iirod  until  do.it  h in 
sovoral  woi'ks  . I'nit  sur  v i v.ih  i 1 i t v w.is  .issi-ssud  tor  hot  h 11’  and  IT 
i no.ip.io  i t .It  i ons . I..11  ont  li'lh.ilitv  was  not  oonsidorod.  sinoo  porsonnol 

oxpor  i ono  i n>’,  this  t vi'o  ot  o.isu.iltv  o.in  oont  iniu’  to  pi-rlorm  thoir  oomh.it 
t.isks  lonp  onouiih  to  oonduot  .1  t.iot  io.il  nuoloar  onoountor. 

riu'  nil'. ms  .ind  st.itul.ird  dovi.it  ions  tor  tho  two  tvpos  ot  porsonnol 
ino.ipao  i t .U  i on  oonsidorod  .iro  n.ivon  in  V.ihlo  1.  I'lioso  v.iluos  .iro  oht.iinod 
from  .1  lo.ist  sipKiros  I'l  N tit  to  d.it  ,1  on  r.ul  i .it  i on- i nduood  1 no.ip.io  i t .1 1 i on 
U'ot  . h).  I'ho  r. idi.it  ion  p.ir.imotor  is  1 roo- i n-,i  i r doso  in  r.ids. 

.All  porsonnol  oxoopt  t hoso  in  tho  howit.-or  .ind  tho  oomm.iiui 
o.irrior  .iro  oonsidorod  to  ho  tullv  oxj'osod.  Tho  t r.insm  i ss  i on  t.iotor 
tor  tho  shioldod  pi'isonnol  is  t.ikon  .is  ll.S.  ,\11  porsonnol  oxoi-nt  t hoso 
in  tho  HOi'  .ind  Kl’i'  .no  oonsidorod  to  ho  portormiiu'.  phvsio.illv  dom.indin" 
t ,is k s . 

I'nit  su  rv  i v.ih  i 1 i t V w.is  .issossod  tor  hot  h 11'  .ind  IT  i no.ip.io  i t .1- 
tioii.  Fiit.  1 plots  tho  tr. lot  ion  ot  porsonnol  sur\-ivini'.  IP  i no.in.io  i t .1 1 i on 
.IS  .1  tunotion  ot  doso  .it  tho  \'t'.  I'ho  tip.uro  shows  tho  v.iluo  oht.iinod 
tor  throo  t.iot  i.-.il  violds  .ind  t lu'  ourvi'  whioh  tisos  thoir  wi'ij-.htod  v.iluos. 


'i . J Surv  i\ .ih  i 1 i t V ot  R.ulios  ,ind  Kol.itod  Pii^uipr.ont  to  I'Kl'P  I'fi'oots 

ttilit.irv  I'liotronio  .ind  0 oirminn  i o.it  i on  oi]n  i nriont  is  susooptihlo 
to  tho  ottoots  ot  prompt  nuolo.ir  r. idi.it  ion.  For  most  t.iot  io.il  situ.i- 
tions,  nout  ron  t luonoo  li.is  boon  t ound  to  Ih'  tho  prinoip.il  nuolo.ir  on- 
vironr.iont.il  I'.ir. motor  whioh  o.iusos  porm.inont  d.im.ip.o  to  olootronio 
I'qii  i pniont  trot  . ').  tho  lo>’,.irithm  ot  tho  tluonoo  tor  whioh  thoro  is 

.1  AO  poi'oont  ('rol'.ih  i 1 i I \ ot  0 i ron  i t 'svst  on  t.iiluro  dotinos  M in  Fq  . 1 
tor  porm.inont  d.im.iqo  to  olootronio  .ind  oommnn  i o.it  i on  svstoms. 

.All  r.idios  .md  .issooi.itod  olootronio  oquipnoiit  .issinnod  to  tho 
h.it  ti'fv  woro  oi'nsidorod  in  tho  .issossnont  ot  oomnnn  i o.it  i ons  oqnipmont 
surv  i v.ih  i 1 i t V . Iho  mo. in  .md  siqm.i  tor  tho  r.ulios  .md  .issooi.itod  oquin- 
inont  of  tho  h.ittorv  woro  dotorninod  .is  dosoi'ihod  in  soot  ion  ■<  omnlovinr 
vu  I nor.ihi  1 i t V d.it  .1  o.ivon  in  rot.  .•! . 
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Table  1 Personnel  Nuclear  Radiation  Vulnerability  Data. 


FRACTION  OF  PERSONNEL  SURVIVING  IMMEDIATE 
PERMANENT  INCAPACITATION 
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Figure  3.  Personnel  Survivability  Profile  for  Field  Artillery  Battery. 
155MM,  Self  Propelled,  Tactically  Deployed. 


5.5  vabJJ  i ty  of  Vt-h  i c to  blast  Kffoot.s 

* 

Stamiard  roforonces  wliich  specify  vulnerability  criteria  for 
determination  of  blast  damage  to  vebicles  yield  incon.sistent  results 
when  used  to  assess  survivability  of  like  equipment  (ref.  8).  A blast 
damage  assessment  methodology  is  currently  under  development  by  the 
ballistics  Kesearch  Laboratory  (BRL)  and  HDL  in  a Defense  Nuclear  Agenev 
(DN'A)-sponsored  tactical  nuclear  warfare  program.  This  methodology  is 
intended  to  result  in  mi'rt"  realistic  vu  1 nerab  i 1 i t v criteria  for  use  in 
assessmeiit  of  vehicle  blast  damage  tlian  the  current  widely  used  references 
(ref.  h and  105  provide.  The  method  considers  tlie  probability  of  vehicle 
overturn  to  he  described  by  a (5LN  distribution  function  fi>r  specific 
NUT',  par.imeters,  similar  to  radiation  incapacitation  of  personnel  and 
radiation-induced  failure  of  electronic  equinment.  The  blast  parameters 
used  are  the  overpressvire  (,'.P)  and  tlie  dvnamic  pressure  impulse  (1  ). 
rhe  logarithm  of  the  value  of  (',P!  - K)  which  gives  a 50  pert'cnt  ^ 

probability  of  a vehicle  overturnii^g  defines  M in  Kq . 1.  K is  the 
v.ilue  of  API  below  whiclt  a veliicle  will  not  overturn. 

q 

In  determining  unit  veliicle  survivability,  each  type  of  vehicle 
was  considered  separately  because  vehicle  survivability  varies  greatlv 
with  vehicle  tvpe,  espei-iallv  between  the  tracked  .ind  wheeled  tvpes. 
rhe  vehicle  tvpes  considereii  wi>re  the  Oargi'  Carrier  M548,  command 
carrier,  1/4  ton  triu'k,  Carama  Coat,  and  l-\ll  ton  truck.  The  155  mm 
howit7.cr  was  not  considered  bei-ause  this  vehicle  is  the  least  vulnerable 
item  over  the  r.angi'  of  yields.  From  ref.  8,  values  were  obtained  for 
the  mean,  standard  deviation,  .uul  overturning  c'onstant  of  the  Cl.N  dis- 
tribution of  overturning  probability  as  a function  of  .MM  for  each 
vehicli>  type. 

The  survivability  of  eacTi  groiqi  of  like  vehicles  of  the  battery 
was  determined  generally  us  described  in  section  4.  For  each  yield,  a 
value  of  the  overturning  constant  for  the  .irray  is  first  determined  by 
ascertaining  the  minimum  value  of  MM  that  results  in  overturning  anv 
vehicle  of  the  array.  A C.LN  fit  of  (*^81  - K)  gives  the  mean  and  sigma 

for  the  array  for  each  yield.  Weighted  v^alues  of  tiie  mean,  sigm.a,  and 
overturning  constant  are  then  obtained. 

6.  Nuclear  Fffects  Si^rv i valyi  1 i t y of_  1 5/^  mm  Bat  tery 

In  addition  to  assessing  the  NU'F  survivability  of  the  b.itterv  in 
the  tactical  conf  igurat  ion,  we  also  assesse<l  it  in  other  deployments. 

The  deployments  considered  were  the  staging  area  .uid  the  road  marcli. 
Baseline  position  areas  wore  established  for  theso  additional  unit 
configurations. 

The  staging  area  comprises  per.sonnel  and  oqiiipmotit  tliat  are  gener.illv 
uniformly  distributed.  Therefore,  one  would  expect  the  \C  to  he  near 
the  unit  geometrical  center,  and  it  was.  .Fiirv  iv.ih  i 1 i t y of  e.aclt  unit  in 
a staging  area  was  assessed  in  tlie  same  manner  as  for  the  laetie.il  .areas. 
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The  road  mareh  layouts  are  unique  in  that  they  are  one-dimensional 
arrays  spread  out  over  a considerable  distance.  A modification  of  t he 
method  of  assessing,  survivability  was  devised  to  deal  with  this  situa- 
tion. It  was  discovered  that  three  vulnerability  tenters  are  required 
to  describe  a road  marth. 

7.  y.u.lir^rabi  1 i t V Due  to  Multiple  bursts 

The  method  of  section  4 is  applicable  for  multiple  bursts  for  |)er- 
sonnel  incapacitation  due  to  prompt  radiation  and  damage  tt>  electronic 
equipment  due  to  neutron  fluonce  because  these  effects  are  cumulative. 
Therefore,  to  assess  the  unit  survivability,  one  totals  the  di'se  or 
f luence  level  at  the  VC,  for  each  effect.  I'hen  one  determini's  t lie 
survival  probability  for  that  level  from  the  appropriate  expression 
for  survival  probability  as  a function  of  the  environment  at  the  VC. 

8 . Tact  i cal  I'nit  Sensitivi  ty  Studio s 

This  method  was  used  to  conduct  sensitivity  studies  on  the  155  mm 
battery.  Unit  survivabilities  for  the  different  dt'plovTnents  were  com- 
pared, as  well  as  doctrinal  approaches  (shieldinp,  and  dispersion)  for 
increasing  unit  survivability.  The  shielding  postures  were  personnel 
and  equipment  in  foxholes,  in  a forest,  and  in  foxholes  in  a forest. 

The  comparison  of  unit  survivability  of  the  battery  in  the  tactical 
and  staging  area  configurations  showed  that  personnel  are  slightly  more 
vulnerable  to  the  effects  of  initial  nuclear  radiation  in  the  staging 
area.  This  survivability  comparison  is  shown  in  Fig.  4 for  the  two 
conf  igurat i<ins  for  the  fraction  of  personnel  surviving  IP  incapacitation 
versus  the  range  of  .AGZ  to  \T'  for  the  155  mm  battery.  These  configura- 
tions differ  in  survivability  because  fewer  people  are  shielded  in  the 
staging  area.  (\imparison  of  survivability  of  radios  and  vehicles  for 
tactical  versus  staging  are.a  deplo\Tnents  showed  no  significant  differences 

The  baseline  tactical  position  area  for  the  1 55  mm  battery  was 
increased  to  a.ssess  the  i-ffect  of  unit  dispersion  on  vulner.abi  I i ty . 

Fig.  5 shows  this  effect  for  personnel  survivability  to  IP  incapacita- 
tion. For  all  values  of  probabilirv  of  survival  greater  than  about  50 
percent,  the  unit  survivability  actually  decreases  as  the  unit  area  in- 
creases. This  apparently  paradoxical  result  arises  from  the  wide  range 
of  lethality  of  a nuclear  device.  Dispersing  a unit  increases  the 
probability  that  someone  will  be  injured,  even  though  it  decreases 
the  probability  that  the  entire  unit  will  be  destroyed.  For  values 
of  probability  of  survival  of  less  than  approximately  50  percent,  the 
unit  survivability  increases  as  the  unit  area  increases. 

The  effect  of  shielding  on  unit  survivability  was  investigated. 

The  postures  considered  were  personnel  and  equipment  in  foxholes,  in 
a forest,  and  in  foxholes  in  a forest.  For  the  shielding  cases 
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Comparison  of  Personnel  IP  Survivability  for  Field  Artillery  Battery 
155MM,  Self  Propelled  in  Tactical  and  Staging  Areas. 


N0llVXI3VdV3NI  INBNVWUad  diVIQaWNI 
DNIAIAUnS  13NN0SU3d  dO  N0li3VUd 


Artillery  Battery,  155MM,  Self  Propelled,  Tactically  Deployed. 


I’onti  iilori'cl , t hi'  groatest  iiuTi'aso  in  unit  survivability  was  roalizi'd 
tor  tho  unit  deployoii  in  a forost  ami  in  a prot  ort  oil  posturo  (ioxholos). 
riit'  survivability  ot  radios  ran  bo  onhanood  s i pn  i I ioant  I v by  shioldinp 
atfordod  by  a t'orost  whoroas  porsonnol  surv  ivab  i 1 i t v is  improvod  moro 
bv  sliioldinp  at  fordod  bv  protoot  ivo  sboltors.  Similar  rosults  liavo 
boi'ii  obtainod  bv  othor  moans.  Tho  sipnifioanoo  is  that  a small  unit, 
howover  sliioldod,  oan  bo  roprosontod  as  a point  tarpot. 

Sunmiary  and  Cono  1 us  i ons 

This  papor  di'soribos  tho  mothods  dovolopod  at  liDl.  for  tho  assossnu'tit 
ol  small  unit  NWl’  surv  ivab  i 1 i t v and  prosonts  siimo  rosults  i>f  applvinp, 
tl\is  mothod  to  till'  15S  mm  firinp  b.ittorv  in  a ntioU'ar  onpapomont  . Tho 
unit  is  dosoribod  as  .a  point  tarpot,  ami  oxisiinp  vu  1 nor.ibi  1 i t v/ 
surv i vab i 1 i t V information  is  usod.  This  mothod  pormits  simplor  input 
to  w.irpamos. 

I'ht'  probability  of  survival  of  a small,  laotioallv  do|)loyod  unit 
oan  bo  dosoribod  bv  a ('l,N  distribution  of  propi'rlv  solootod  onviron- 
mi'utal  paramotors.  Azimuthal  variations  in  vu  1 norab  i 1 i t v <'f  t lu'  unit 
oan  bo  madi'  noplipiblo  by  propor  solootii'ii  of  a p.iir  of  rofori'tioo 
oov'rd  i nat  os  , thi’  vu  1 norab  i I i t v oonti-r. 

Tho  analysis  of  tho  howitzor  battorv  oi'nsidorod  I host'  NWl'  I'nviron- 
mouts  that  dominato  tho  vu 1 norab i I i t v of  tho  onuipmont  .ind  porsonnol 
IH'sitionod  in  tvpioal  taotioal  aroa  lavouts.  Thosi-  ot  foots  woro 
nuoloar  radiation  doso  to  porsonnol,  TRKl'.  on  radios  and  ri'l.itod  oloo- 
tronio  oquipmont,  and  vohii  lo  <n'i'rturn.  Two  oonsiants  oan  bi’  foumi 
that  dosoribo  tho  vu  1 norab  i 1 i t v of  t hi'  unit  to  oaoh  onv  i ronmoTU  a 1 
paramot  i'  r. 

Tho  small-unit  surv ivab i 1 i t v assossmont  mothod  was  usod  to  porform 
si'iisitivilv  studios  on  tho  ISS  mm  b.ittorv.  As  a rosult  ol  t hoso  studios, 
sipnifioant  oonolnsions  oan  bo  drawn  for  Ibis  unit.  I'ho  oomi'arison 
botwoon  unit  survivability  of  .i  unit  t.iot  io.illv  dojilovod  and  of  a unit 
doployod  in  a stapinp  aroa  showi'd  that  pi'rsonnol  aro  moro  vulnorablo 
to  initial  nuoloar  radiation  offoots  in  tho  st.ipinp  aroa  boo.uiso  .i 
hiphor  fr.'U'tion  of  tho  unit  is  unprotootod  tlioii'.  No  sipnitioant 
diffori'iioo  was  obsorvod  in  tho  surv  ivabi  1 i t v ol  r.idios  or  vohiolos 
for  a doployod  unit  vorsus  a unit  in  a stapinp  .ii  i-.i.  for  t hi'  shioldinp 
o.isos  oonsidorod,  tho  proatost  inoro.aso  in  unit  surv  i v.ib  i I i t v w.is 
obsorvod  for  tho  unit  doplovi'd  in  a forost  .and  in  .i  prolootod  posturo 
(foxholos).  Tho  surv  I v.ib  i 1 i I v of  r.idios  o.in  bo  onh.inood  s i pn  i I i o.in  t 1 v 
by  shioldinp  .afforded  bv  a fori'st  , whoro.is  porsonnol  surv  iv.ib  i 1 i t v is 
I’lihanood  moro  bv  shioldinp  .affordod  bv  protootivo  sboltors. 

Somowh.at  surpr  i s i up  1 y , whon  t Iw  offoots  of  disporsion  of  tho  t.io- 
tioal  aro.a  woro  oonsidi'rod,  wo  found  that,  as  tho  unit  aroa  inoro.isod 
for  all  v.iluos  of  probabilitv  of  surviv.al  proator  t h.in  Sd  poioont  , tho 


unit  survivability  for  personnel  decreased.  However,  as  the  unit  area 
increased  for  all  values  of  probability  of  survival  less  than  50  percent, 
the  unit  survivability  for  personnel  increased. 

Vulnerability  data  similar  to  those  obtained  are  bein'?  generated 
for  other  tactical  units  in  an  assortment  of  deployment  configurations. 
These  data  are  in  a form  that  can  be  readily  added  to  a computer  file 
and  used  with  larger  nuclear  survivability  assessment  or  wargaming 
programs.  This  process  will  facilitate  the  task  of  investigating  the 
survivability  of  theater  nuclear  forces  during  conduct  of  tactical 
nuclear  warfare  studies. 
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ABSTRACT 


There  is  a lacK  of  analytical  information  concerning  the  Battalion  ocne- 
lon  command  and  control  process;  no  methodology  is  Known  to  emst  lor  tne 
quantitative  analysis  of  the  process.  To  develop  such  a methodology,  the 
battalion  command  and  control  process  must  first  he  analy;eo  and  defined. 
This  paper  defines  the  current  maneuver  battalion  command  ano  control 
system  and  the  information  flow  within  this  system.  Several  levels  of 
hierarchical  process  flow  of  battalion  operation  are  presented  in  flow- 
chart format.  These  diagrams  encompass  the  comoat  functions  of  tne  bat- 
talion together  with  tne  command  and  control  functions.  Rrior  to  com- 
puter simulation,  future  efforts  will  be  required  to  further  detail  tne 
logic  of  oattalion  operations  and  to  determine  the  parameters  considered 
by  the  decision  maker  under  combat  conditions.  Application  of  these  re- 
sults to  combat  simulations  would  allow  quantitative  analysis  of  tne  oat- 
talion command  and  control  system! s)  and  permit  trade-offs  between  com- 
peting materiel  support  systems. 


1.  INTRODUCTION 

Published  research  concerning  command  and  control  systems 
either  has  been  oriented  towaro  organi zations  at  division  echelon  and 
above  or  has  tended  to  concentrate  on  individual  hardware  and  software 
systems  such  as  the  Tactical  Operations  System.  None  is  known  to  have 
analyzed  the  total  system,  including  the  individual  decision  maker,  as  it 
is  employed  in  combat  by  a maneuver  battalion.  Principal  analytical  mea- 
sures used  previously  were  individual  system  performance  and  efficiency, 
(e.g.,  message  failures,  throughput,  and  targets  acquired)  rather  than 
measurement  of  the  change  in  combat  effectiveness  of  the  unit  due  to 
changes  in  the  total  command  and  control  system.  The  result  is  a lack  of 
systematic  analysis  of  command  and  control  oelow  division.  Tnis  has  li- 
mited analyses  of  potential  command  and  control  system  trade-offs  ano  of 
trade-offs  between  dissimilar  systems  to  qualitative  methods.  A simula- 
tion of  maneuver  battalion  combat  containing  all  organic  systems  would 
provide  the  Army  analytical  community  with  a tool  to  provide  a better 
understanding  of  system  trade-offs.  Such  a simulation  could  also  pro- 
vide, or  verify,  modifying  factors  for  higher  echelon  comoat  simulations. 
This  paper  represents  an  initial  step  in  the  analysis  of  command  and  con- 
trol in  combat  at  echelons  below  division. 


II.  METHUDOLUGY 

Work  on  this  project ^as  initiated  by  a search  of  existing  documen- 
tation on  coiiHiiand  and  control  processes.  A literature  search  included 
the  Army  Study  Documentation  and  Information  Retrieval  System  and  the 
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Jetedse  IJocumodtatiofi  Center  compuleri zed  data  dank.  The  literature  re- 
viewed is  listed  in  the  Diol  iograpiiy.  In  addition,  contacts  within  the 
Army  command  and  control  research  and  development  community  were  estab- 
lished to  collect  current  documentation  relative  to  command  and  control 
and  to  exchange  views  and  concepts  on  command  and  control  in  a maneuver 
battalion.  Tnese  contacts  included  representatives  of: 

(1)  TKAUOC  Systems  Analysis  Activity 

(1)  Combined  Arms  Combat  Development  Activity 

(3)  Command  and  beneral  Staff  College 

(4)  Army  Research  Institute 

(b)  Combined  Arms  Tactical  Training  Simulator 
(b)  Armor  School 
(7)  Infantry  School 

The  basic  decision-making  process  represented  in  FM  lUl-b  was 
Charted  and  combined  with  the  definition  of  Command  and  Control  found  in 
AH  31U-ifb  to  develop  a system  description  for  the  battalion  level;  the 
system  description  developed  is  found  in  Section  III.  Subsequently,  the 
logic  of  the  command  and  control  processes  was  synthesized  and  is  de- 
scribed in  Section  V. 

Concurrent  with  the  development  of  system  description  and  logic, 
research  was  conducted  in  the  area  of  decision  theory.  In  addition,  the 
suitability  of  current  models  that  might  be  adaptable  to  analyses  of  the 
battalion  Comiand  and  Control  system  was  investigated.  This  research  is 
summarized  in  Section  IV  and  Appendix  1. 


III.  COMMAND  AND  CONTROL  DtFINITION 

A command  and  control  system  is  defined  as  "the  facilities,  equip- 
ment, communications,  procedures,  and  personnel  essential  to  a commander 
for  planning,  directing,  and  controlling  operations  of  assigned  forces 
pursuant  to  the  missions."*  Analysis  of  this  definition  permits  identi- 
fication of  its  components;  Elements,  Decision-maker,  Functions  and  Mis- 
sion. The  elements  (facilities,  equipment,  persoi\nel , communications, 
and  procedures)  are  the  tools  required  by  the  decision-maker  (commander) 
to  perform  the  management  functions  (planning,  directing,  and  con- 
trolling) to  accomplish  his  mission.  This  compartinental  definition  is 
illustrated  in  Figure  1.  FM  71-2  states,  "Command  is  a very  personal 
thing,"**  and,  as  a result,  the  individual  battalion  Command  ana  Control 
system  will  vary  between  commanders  within  the  constraints  of  the  formal 
defini tion. 


*AR  31U-25,  I June  1972,  p 127 

**FM  71-2,  23  July  1976  (draft),  p 3-14,  3-15 


ELEMENTS 

DECISION 
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FUNCTIONS 
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COMMUNICATIONS 
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i PLANNINO  ) 
{ DIRECTINO  > 
( CONTROLLING  1 

OPERATIONS 

Figure  1.  Command  and  Control  System  Uefinition 


The  battalion  Command  and  Control  system  can  be  considered  to  encom- 
pass other  types  of  systems  for  analytical  purposes.  Since  there  is  a 
flow  of  information  within  the  command  and  control  system,  without  which 
the  system  presumably  would  not  work,  at  least  portions  of  the  command 
and  control  system  can  be  likened  to  an  information  processing  system. 

The  decision  making  system  (commander)  does  not  process  information  per 
se  but  rather  uses  information  to  formulate  a plan  which  ultimately  re- 
sults in  the  issuance  of  orders--the  directing  function  of  command  and 
control.  The  separation  of  command  and  staff  actions  into  these  two 
types  of  systems  is  shown  in  Figure  2.  It  should  be  noted  that  the  use 
of  the  word  “information"  in  this  context  is  a broad  one  including  both 
intelligence  and  combat  information  as  well  as  directives  from  higher 
headquarters.  A block  diagram.  Figure  2,  shows  the  information  flow 
within  the  command  and  control  system.  It  is  the  total  of  all  the  pieces 
of  information  which  enters  into  the  general  function  which  has  been 
termed  "Collection"  in  this  figure.  (This  summation  of  information  is  a 
variable  based  on  the  quality  of  the  information  collection  system). 
Through  the  use  of  the  personnel  and  equipment  within  the  allocated  fa- 
cilities this  mass  of  information  is  analyzed,  synthesized,  and  otherwise 
processed.  The  commander  at  each  decision  point  may  then  call  upon  the 
system  to  provide  pertinent  data  for  each  decision  as  it  arises.  Of 
course,  he  is  not  prevented  from  further  diagnosing  or  amending  the  data 
he  receives.  Factors  such  as  experience  contribute  to  such  amendments 
prior  to  the  decision  and  subsequent  issuance  of  the  order  or  guidance. 

within  the  command  and  control  system,  information  tak^s  several 
forms.  At  its  arrival  into  the  system,  it  is  a combination  of  raw  data 
and  synthesized  data.  This  information  is  converted,  where  possible,  to 
increase  the  proportion  of  synthesized  data  (data  which  have  been  ana- 
lyzed and  combined  with  previous  data).  The  combination  is  stored  for 
retrieval  by  the  commander  or  his  support  staff.  As  new  combat  data  are 
received,  they  are  added  to  the  existing  store  of  knowlege,  in  a synthe- 
sized form  if  possible.  as  the  commander  retrieves  information,  he  can, 
at  nis  option,  further  change  or  add  to  it.  Upon  reaching  his  decision, 
the  factors  considered  in  that  decision  are  melded  into  a new  form  as 
well  as  being  retained  in  their  previous  form.  The  new  form  is  his 
order. 


Figure  2 

^Field  Manual  lol-b. 


Infornation  Processinq  Systen^ 


Decision  MrtKino  Svsle^ 


Figure  J.  Command  and.  Control  Infoni\at)on  Flow 


The  environment  in  Figure  i is  the  commander's  area  of  influence  and 
interest.  All  forces  must  De  accounted  for  in  this  environment:  nis 
superiors  and  subordinates,  the  enemy,  those  weapons  and  equipment  out- 
side his  geographical  area  which  can  cause  effects  within  it,  and  those 
forces  which  will  shortly  come  within  the  geographical  area.  Thus,  the 
commander's  environment  is  the  source  of  all  information  which  he  con- 
siders. In  fact,  one  of  the  functions  of  combat  information  processing 
is  that  of  filtering  extraneous  information  from  outside  his  environment. 


IV.  UECISION  MAKING 

The  intent  of  the  combat  orders  issued  by  the  commander  is  to  alter 
the  environment  in  some  manner,  e.g.,  change  unit  locations,  cause  enemy 
attrition,  reinforce  units.  This  order,  in  combination  with  other 
orders,  can  be  assessed  as  to  its  effect  on  the  environment.  This  is  the 
commander's  basis  for  determining  whether  the  mission  has  been  accom- 
plished. In  modeling  and  studies  this  effect  is  the  measure  of  comoat/ 
force  effectiveness.  In  combat  the  effect  on  environment  is  assessed  by 
the  sensing  system  (e.g.,  radar,  observations).  Again,  the  broad  defini- 
tion of  sensing  is  used,  hence  the  inclusion  of  human  eyes  and  other  hu- 
man senses  with  electronic  systems.  Each  time  information  is  sensed  the 
process  function  operates  to  assimilate  the  new  data  into  the  existing 
"information  file."  This  in  turn  may  reset  those  parameters  which  the 
decision  maker  evaluates  in  arriving  at  his  decision.  This  "information 
file"  currently  exists  in  the  maps,  journals,  message  logs,  and  memories 
of  the  commander  and  staff. 
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bdine  theory  (a  subset  of  Decision  Theory,  Appendix  B)  postulates 
that  each  player  will  optimize  those  factors  which  would  lead  to  attain- 
ment of  his  Objectives.  In  the  remainder  of  this  paper,  it  is  assumed 
that  the  only  variables  which  the  commander  considers  in  arriving  at  the 
estimate  of  the  situation  are  the  elements  of  METTTS  (states  of  the 
mission,  enemy,  troops  available,  terrain,  time,  space).  These  are  state 
variables  which  generally  take  on  continuous  values.  Table  1 presents 
the  current  definition  of  METTTS  and  postulates  three  conditions  for  each 
variable.  It  is  recognized  that  the  values  of  many  elements  in  real  life 
are  continuous.  The  restriction  to  three  conditions  for  each  state  vari- 
able is  for  illustrative  purposes  only,  as  is  the  restriction  to  six 
state  variables.  As  previously  mentioned,  further  research  in  military 
decision  making  is  required  to  determine  the  li<^t  of  variables  to  be 
used. 
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Taole  1.  Command  Decisions 


Variables 
Mi ssion 
Enemy 

Troops  Available 
Terrain/Weather 
Time  Available 
Space  (Maneuver) 


State 

Attack,  Defend,  Retrograde 

Heavy,  Moderate,  Light 

Heavy,  Moderate,  Light 

Good,  Indifferent,  Bad 

Long,  Moderate,  Short 

Unrestricted,  Moderately 
Restricted,  Restricted 


The  assumptions  suggested  by  METTTS  are  that  the  commander  knows 
certain  information  and  estimates  certain  information,  thus  leading  to 
actual  and  inferred,  or  perceived,  states  respectively.  One  additional 
state  can  be  considered:  the  desired  state.  The  hypothesis  is  that  if 
the  commander's  environment  is  the  actual  state,  his  imperfect  knowledge 
degrades  this  actual  state  to  the  inferred  state  and  his  mission  is 
planned  to  lead  him  toward  the  desired  state.  Any  time  the  inferred  and 
desired  states  are  not  the  same  he  will  make  a combat  decision  to  act. 
During  combat  the  inferred  and  desired  states  will  seldom,  if  ever,  be 
congruent.  This  is  due  to  the  changing  of  the  desired  state  by  the  com- 
mander's reassessment  or  by  preparation  for  future  courses  of  action. 

The  inferred  state  can  be  altered  also  by  new  information  concerning  one 
or  more  of  the  decision  variables.  The  commander  will  continue  to  make 
combat  decisions  based  on  the  METTTS  variables  until  the  states  are  iden- 
tical due  to  cessation  of  combat. 

Consider  the  situation  where  the  commander  is  given  the  mission  to 
attack.  The  mission  variable  of  METTTS  is  a "given"  and  hence  actual  and 
inferred  states  are  equal,  but  could  be  changed  at  a later  time  by 
authority  of  higher  echelon  commanders  or  by  the  battalion  commander's 
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analysis  of  potential  future  missions.  An  example  of  actual,  inferred, 
and  desired  states  is  given  in  Table  1. 


Table  1.  Decision  Variable  Examples 


Variable 

Mi ssion 

Enemy 

Troops 

Terrain 

T ime 

Space 

Desired  state 

Attack 

Light 

Heavy 

Dood 

Long 

Unrestricted 

Inferred  state 

Attack 

Light 

Moderate 

Dad 

Long 

Unrestricted 

Actual  state 

Attack 

Moderate 

Moderate 

Bad 

Moderate 

Unrestricted 

In  this  example  it  can  oe  seen  that  the  commander  is  facing  a moder- 
ate strength  enemy  force  with  his  own  unit  having  moderate  strength  in 
bad  terrain  with  a moderate  amount  of  time  available  to  react.  Decisions 
he  makes  will  be  oased  upon  the  inferred  state  of  the  environment  which 
is  not  identical  to  the  actual  state  due  to  imprecise,  imperfect,  or 
otherwise  faulty  information.  Therefore,  given  superior  forces,  the  com- 
mander may  first  attempt  to  maneuver  to  better  terrain.  Had  his  informa- 
tion been  perfect  (or  at  least  better),  he  would  have  known  that  the  en- 
emy force  approximated  his  strength  and  was  concentrated  closer  to  his 
units,  giving  a snorter  time  element  than  he  estimated.  The  outcome  of 
the  attempted  maneuver  toward  better  terrain  is  based  un  the  reactions  of 
this  higher  strength  enemy  force.  The  command  and  control  system  pro- 
vided him  with  erroneous  information,  possibly  causing  him  to  execute  the 
wrong  decision  which  could  result  in  a different  outcome  than  desired. 

If  the  command  and  control  system  which  provided  the  information  in 
Table  I were  different  due  to  an  alternative  configuration,  the  two  "com- 
petitive" systems  could  oe  compared  based  on  resultant  combat  measures  of 
effectiveness,  i.e.,  tne  combat  outcomes  of  two  identical  battalions  each 
employing  a different  command  ano  control  system.  Tne  quality  of  the 
information  provided  to  the  decision  maker  directly  affects  the  decision 
made,  thus  translating  the  performance  measures  (speed,  efficiency,  and 
quantity)  into  combat  outcomes. 

To  further  consider  the  previous  example,  the  commander  (in  the 
inferred  state)  in  general  desires  to  maximize  his  forces  and  minimize 
the  enemy  forces  in  the  best  terrain  with  maximum  time  to  react  and  space 
to  maneuver.  The  situation  may  prevent  such  actions,  however.  An  attack 
order  contains  many  elements  to  be  considered  in  the  planning  phase  of 
the  combat.  It  may  not  permit  a change  of  terrain  or  an  increase  in 
forces.  If  it  does  not,  the  commander  could  decide  to  request  such 
changes  if  they  impact  on  the  higher  echelon's  environment.  If  the  re- 
quest or  orders  prevent  such  actions,  as  is  usually  the  case  at  battal- 
ion, the  commander  can  never  enter  the  desired  state  but  will  still  try 
to  optimize  the  remaining  factors. 
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It  should  De  reinemDered  that  the  commander  is  not  considering  one 
sequence  of  decisions  but  rather  a series  of  overlapping  decisions  and 
actions.  The  result  of  ttiis  sequence  is  the  outcome  of  the  comoat.  Such 
a multiplicity  of  information  flow.  Doth  to  and  from  the  commander,  if  a 
cause  of  queuing  in  the  various  subsystems,  e.g.,  fire  requests  to  ar- 
tillery and  calls  through  the  communications  system  in  excess  of  its  ca- 
pacity. 


V.  CUMMANU  AND  CONTROL  LOOIC 

from  a logical  viewpoint,  the  Battalion  Command  and  Control  system 
can  De  diagram  as  a process  flowchart  (Figure  4).  From  this  overview,  it 
is  seen  that  the  overall  process  begins  with  receipt  of  comoat  orders 
from  higher  echelons  which  are  then  processed  through  the  planning  phase 
resulting  in  directions  to  the  battalion  elements  for  their  portions  of 
combat.  In  the  planning  phase  alternative  plans  are  determined  which 
must  be  evaluated  with  the  resultant  selection  of  the  "best"  plan  for  the 
battalion.  Other  plans  considered  may  become  contingencies  to  oe  acted 
upon  when  the  original  plan  must  be  replaced  or  altered.  Upon  receipt  of 
subsequent  orders  to  "act"  trie  EXECUTE  process,  which  controls  all  pro- 
cesses needed  during  combat,  is  started.  Movement  is  "begun"  at  any  ve- 
locity; positive,  negative,  or  zero  (i.e.,  depenoing  on  METTTS  factors, 
movement  could  be  in  any  oirection  at  any  allowable  velocity,  including 
zero).  During  movement,  personnel  do  not  turn  off  their  senses  so  that 
the  human  sensing  process  called  OBSERVE  is  always  providing  additional 
information.  Decisions  are  required  to  obtain  electronic  surveillance  by 
the  SENSOR  process,  to  provide  FIRE  SUPPORT  and  DIRECT  FIRE  on  targets, 
and  to  change  plans.  Upon  completion  of  the  optional  processes  the  lXE- 
CUTE  process  is  continued.  Once  the  sequence  of  decisions  and  actions  is 
completed,  the  EXECUTE  process  is  repeated  ano  each  decision  is  reevalu- 
ated by  the  commander.  It  is  assumed  tnat  within  each  process  are  commu- 
nications effects,  the  expendi ture- resupply  process,  and  damage  assess- 
ment. Of  these  only  some  communications  delays  will  be  illustrated  in 
this  paper. 

Each  of  the  processes  and  functions  of  ttie  abbreviated  logic  diagram 
(Figure  4)  has  been  flowcharted  in  greater  detail.  Future  work  must  pro- 
vide even  greater  detail  if  the  command  and  control  process  is  to  be 
simulated  by  a computer  model.  Trie  detailed  logic  is  snown  in  Figures  o 
through  10  with  narrative  explanations  of  each  of  these  subroutines  con- 
tained in  the  following  paragraptis.  It  should  be  noted  that  certain  de- 
tails are  not  duplicated  in  each  flowchart  such  as  the  decision  to  co.nmu- 
nicate  and  the  question  of  ability  to  communicate.  Alysis  ''equired  for 
the  decision  is  assumed  to  be  included  in  tne  decision  block.  An  addi- 
tional levels  of  analysis  should  include  tnese  details. 

a.  PLAN 

(1)  The  logic  for  trie  process  called  P^An  is  contained  in  Fi- 
gure b.  Should  no  orders  oe  received,  tne  logical  system  allows  tne 
battalion  to  assess  the  "prepare  to"  portion  ot  tne  previously  received 
order.  If  orders  are  received,  the  variables  in  tne  commander's  "tile  ot 
information"  (consisting  of  journals,  maps  and  staff  memories)  are  ad- 
justed to  any  new  values  contained  in  the  orders.  Tins  tile  must  .:ontain 


dll  varidDles  which  the  decision  maker  utilizes  to  select  the  proper  al- 
ternative. Those  variables  which  are  determined  by  intelligence  and 
other  variables  which  are  estimated  are  in  the  commander's  information 
file  as  trie  inferred  state.  Any  decisions  made  are  based  on  tne  interred 
values  of  variables  while  damage  assessment  and  other  combat  results  are 
based  on  the  actual  values  of  the  variables. 

(<?)  fLAN  provides  implementable  orders  to  the  elements  of  the 
Battalion.  In  it  various  alternative  plans  are  developed,  ordered  by 
worth  or  utility  (based  on  the  commander's  judgment)  and  checked  against 
some  minimal  level  of  worth.  Inputs  to  the  evaluation  process  include  all 
those  variables  he  considers  for  other  decisions.  Ihe  plan  with  the 
highest  worth  becomes  the  plan  to  implement  and  the  plan  with  second 
highest  worth  becomes  a possible  contingency  plan.  Should  no  plans  be 
possible  which  are  above  the  minimal  worth,  a default  occurs.  This  could 
result  in  the  implementation  of  one  of  the  determined  plans  or  of  a hold 
order  depending  on  the  additional  guidance  given  to  the  Battalion  com- 
mander by  Brigade. 

b.  EXLXUR 

(1)  IXtCUTL  is  the  central  process  for  the  combat  portion  of 
the  logic  system.  LXtCUTL  (Figure  o)  includes  the  movement  of  tne  units 
on  the  battlefield  and  decisions  concerning  the  optional  processes  of 
comoat.  The  speed  of  movement  is  adjusted  to  reflect  those  variables  in 
the  information  file  which  impact  on  movement.  Fxamples  of  these  are 
mission,  inferred  enemy  location  and  strength,  friendly  nwde  of  transpor- 
tation, and  terrain  characteri sties.  Both  positive  and  negative  iitovement 
(e.g.,  advance  and  retreat),  as  well  as  zero,  movement  is  permitted. 
Command  and  control  is  exercised  by  a comparison  of  the  locations  of  the 
subordinate  units  to  the  commander's  control  measures  developed  in  the 
plan.  Two  bases  for  changing  the  plan  are  illustrated.  Ihe  first  is  the 
cnange  of  information  file  values  beyond  some  input  values.  Ihe  second 
is  the  loss  of  contact  with  a unit,  tach  of  these  events  results  in  the 
commander  doing  additional  planning  via  the  PLAN  process  to  develop  a new 
plan  based  on  the  new  data  available. 

(Z)  Ihe  non-movement  portions  of  FXLCLITL  consist  ot  several 
decisions  on  tne  part  of  the  commander.  If  electronic  surveillance  is 
desired,  tne  SL.NSdB  process  enters  the  logical  system;  if  the  use  of  such 
devices  is  not  desired,  the  process  continues  with  only  UBbFKVl  (human) 
inputs  available  to  update  the  information  file,  when  enemy  units  which 
exceed  a threshhold  of  target  worth  come  within  range  of  either  indirect 
or  direct  fire  systems,  the  ^ IBf  ShPPUKl  or  DlKtCT  f IBl  processes  are 
involved,  depending  on  the  information  entering  the  commander's  deci- 
sio'ns.  Ine  communications  effect  on  tiie  process  flow  is  a del.iy  in 
transmission  of  information.  Until  updatt'd  information  is  transmitted 
and  receiveil,  the  combat  proceeds  without  it. 

c.  ObStBVL.  Ihe  tlowciiart  for  the  ObbiLKVL  process  is  shown  in 
Figure  /.  Tnis  process  includes  the  human  physical  senses  of  sight, 
hearing,  and  smell  used  by  personnel  to  provide  information  about  the 
combat  situation,  specifically  about  the  variables  in  the  information 
file.  Communication  may  not  be  permitted  under  certain  conditions.  If 
this  is  the  case,  only  the  local  echelon  information  file  is  updated  with 
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new  information;  the  battalion  commander  and  staff  would  continue  operat- 
ing on  older  information  until  the  communications  limitations  are 
changed.  Shell  Reports  should  be  provided  when  fire  has  been  or  is  being 
received.  Data  gathered  from  captured  equipment,  interrogated  prisoners 
and  discovered  documents  are  also  included  in  this  process. 

d.  SENSOR.  When  electronic  surveillance  is  desired,  the  SENSOR 
process  (Figure  b)  is  invoked.  The  first  question  asked  is  whether  any 
devices  for  such  surveillance  are  organically  available  to  the  battalion. 
If  not,  the  battalion  obviously  cannot  deploy  them.  Oiven  that  devices 
are  available,  the  deployment  of  the  teams  with  the  devices  is  made.  The 
"team"  is  also  given  the  characteristics  of  the  device,  their  mission  and 
information  from  the  file  which  might  affect  the  mission.  The  device  is 
then  switched  on;  if  not  operational  in  some  number  of  attempts  as  deter- 
mined by  the  commander,  the  surveillance  mission  is  abandoned.  If  the 
device  is  operational  the  mission  is  then  carried  out  with  obtained  in- 
formation communicated  (if  possible)  to  the  appropriate  information  files 
for  comparison  with  other  data  and  file  update.  A return  is  made  to  the 
EXECUTE  process  if  additional  missions  are  not  desired. 

e.  DIRECT  FIRE.  The  DIRECT  FIRE  process  is  in  Figure  9.  This 
process  is  a straightforward  sequence  of  computations  to  rank  the  targets 
by  the  threat,  select  the  optimal  target  within  range,  select  the  ammuni- 
tion for  the  effect  desired,  and  fire  all  weapons  within  range  of  the 
target  which  are  required  to  provide  a desired  probability  of  kill.  Dam- 
age is  assessed  and  ammunition  used  is  calculated  after  eacii  mission. 

Upon  firing  at  the  last  target,  the  process  is  ended.  Damage/logistics 
information  is  passed  to  the  commander  for  file  update  if  communication 
is  possiole.  Not  shown  is  a feadback  to  the  OBSERVE,  and  possibly  SENSOR, 
processes  to  provide  the  damage  assessment. 

f.  FIRE  SUPPORT.  The  FIRE  SUPPORT  process  (Figure  lU)  is  en- 
tereo  it  desirable  enemy  targets  are  located  by  tiie  elements  of  the  bat- 
talion. First  a check  is  made  to  determine  if  the  targets  are  within 
designated  restricted  areas.  If  so,  an  attempt  is  made  to  coordinate 
with  other  units.  Should  no  mission  be  possiole  after  coordination,  the 
process  is  ended.  The  next  steps  are  the  rank  ordering  of  the  targets  as 
to  the  desirability  to  fire  against  each  of  them,  and  the  selection  of  an 
indirect  fire  weapon  system  such  as  organic  mortars,  artillery,  or  close 
air  support  from  Air  Force,  Navy,  or  Army  air.  Finally  fire  is  requested 
from  the  desired  system  against  the  target(s).  This  portion  of  the  ac- 
tivity must  consider  the  response  time  of  the  weapon  systems,  the  suit- 
ability of  particular  weapon  systems  against  the  type  of  target  and  the 
safety  of  friendly  units.  The  unit  responsible  for  mission  implementa- 
tion then  checks  the  range,  weapons  appropriateness,  and  response  time. 

If  any  of  these  are  unacceptable,  the  request  is  denied.  Approved  tar- 
gets are  placed  in  a priority  queue.  After  the  mission,  damage  assess- 
ment is  done  and  ammunition  used  is  computed.  Should  all  nonorganic  in- 
direct fire  support  systems  respond  with  a denial  of  the  fire  request, 
the  default  weapon  system  organic  to  the  battalion  may  be  employed.  A 
check,  queue,  fire  and  assess  computation  is  then  done  in  a manner  simi- 
lar to  the  nonorganic  systems. 
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VI. 


ObSLKVATlONS  AND  FUTURE  ACTIONS 


UliSERVATlONS 

0 Despite  the  dvailaDllity  of  documentation  on  the  subject  of  "Com- 
mand and  Control,"  there  has  been  very  little  analysis  of  maneuver  bat- 
talion command  and  control  systems. 

0 Types  of  information  considered  by  the  commander  as  a decision 
maker  have  not  been  fully  identified  or  quantified.  At  oest  they  are 
assumed. 

0 It  appears  that  simulation  of  the  maneuver  battalion  command  and 
control  system  process  is  possible  using  the  logical  processes  identified 
in  this  paper. 

FUTURE  actions 

0 A Human  Research  Need  has  been  submitted  to  and  accepted  by  the 
US  Army  Research  Institute  as  a project  for  oeveluping/ootaining  tne 
variables  whicn  input  to  the  decision  process  of  tlie  battalion  commander 
and  his  staff. 

0 Once  the  variables  are  identified,  ihey  can  ne  combined  with  the 
logic  of  t.ne  Battalion  Command  and  Control  system  to  provide  a met'noaol- 
ogy  for  quantitative  analysis  of  that  system  in  cumbat. 

0 The  decision  variables  could  albO  be  used  to  improve  the  decision 
algorithms  of  current  models. 
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APPENDIX  1 MODEL  EVALUATION 


Early  war  gaming  models  were  totally  manual  affairs.  These  games 
permitted  qualitative  analyses  of  the  command  and  control  aspects  of  a 
staff.  Taole  tops  served  as  displays.  Stochastic  calculations  were  done 
based  on  the  roll  of  dice.  Manual  war  games  were  then  very  strong  on 
logic  but  weak  on  computational  aspects.  With  the  advent  of  computers, 
the  random  throw  of  the  die  could  be  replaced  by  computer  algorithms. 

For  a time  manual  war  games  were  interspersed  witn  computer  runs.  Some 
of  these  games  evolved  to  take  the  form  of  programs  featuring  humans  at 
interactive  consoles,  usually  in  the  role  of  decision  makers. 

In  its  presently  evolved  form,  the  computer  war  game  is  usually  weaK. 
on  command  and  control  logic  since  humans  have  been  taken  out  and  re- 
placed witn  taole  "lookups."  Conversely,  the  games  are  strong  on  fire- 
power calculations,  calculations  of  logistics,  and,  in  fact,  all  of  those 
items  which  had  once  been  table  "lookups"  in  the  early  manual  war  games. 

In  order  to  reintroduce  analysis  of  command  ana  control  into  comoat 
simulations,  we  must  again  include  the  staff.  We  could  in  effect  go  all 
the  way  back  to  tne  original  manual  war  games.  This  is  being  done  at  the 
TRADOC  Combined  Arms  Test  Activity  in  the  various  command  post  exercises 
and  workshops.  However  useful  these  manual  exercises  may  be,  an  itera- 
tive analytical  tool  is  to  be  desired  as  well.  Such  a computer  alterna- 
tive, or  complement  to  these  manual  tests,  would  be  a simulation  of  the 
combat  process  coupled  with  the  command  and  control  processes.  An  ideal 
model  would  be  totally  automated,  include  reasonable  decision  making  al- 
gorithms, and  include  the  components  of  a command  and  control  system  (de- 
tailed previously).  This  would  then  allow  comparison  of  competitive  sys- 
tems in  a combat  environment. 

A cursory  review  of  existing  computerized  models  was  made  to  ascer- 
tain the  ability  of  existing  models  to  simulate  command  and  control  or 
the  feasibility  of  their  being  modified  to  incorporate  a command  and  con- 
trol simulation.  No  attempt  was  made  to  totally  analyze  the  applicabil- 
ity of  each.  A list  of  these  models*,  with  evaluative  comments,  follows: 


*For  a brief  description  of  these  (except  DIVOPS  and  FOURCE)  and  other 
models,  refer  to  Catalog  of  War  Caaming  and  Military  Simulation  Models, 
Studies,  Analysis  and  Gaming  Agency,  6th  Ed,  June  1975,  H.  J.  Walther, 
NTIS  A0/A-U12  8U3. 
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AuvICl  11.  A compuleri  i:eo  Oivision  echelon  luanudl  game  (i.e.,  coritai  ni  rig 
an  exter'nal  aeci  iion-iiiaker ) ot  190/  vintage  which  can  demonstrate  the 
etticiency  of  i ntormati on  flow  but  not  its  combat  effectiveness.  Run 
times  are  long:  i.  days  per  lu  hour  battle. 

cAi'lfb . brigade  resolution  computer  assisted  game  designed  as  a training 
vehicle  for  an  external  decision  maker  (and  staff). 

CARMOULTfL.  Computerized  two  battalion  model  with  tactics  pre-determi ned 
oy  a "decision  maker"  and  provided  as  part  of  the  input  data.  Many  con- 
ditions alter  the  implementation  of  the  decisions.  Designed  and/or  used 
to  study  tactics  and  mixes  of  forces. 

CUMMEL  Il.b.  An  improved  versions  of  COMMLc  llDoJ  vintage).  Heavy  on 
simulation  of  communications  systems;  coupled  with  a divisin  combat  simu- 
lator but  with  simplistic  and  deterministic  decision  logic  based  on  ab- 
stract dimensionless  intelligence  levels  and  modified  firepower  ratios. 

OIVSIFT.  A CObuL  simulation  of  the  manual  staff  functions  in  a division 
TUC;  does  not  consider  combat  decisions,  cannot  be  used  for  automated 
command  and  control  systems,  and  is  not  coupled  with  a combat  simulator. 
Inoperable. 

DIVORS.  Division  level  fully  automated  combat  simulation  with  user  pro- 
vided decision  rules  based  on  perfect  information.  No  command,  control 
or  communications. 

DYNTACS.  battalion  level  combat  simulator  of  extreme  complexity.  Deci- 
sions are  as  complex  as  CARMONETTE,  but  information  flow  is  minimal  al- 
though some  tactical  communications  is  inlcuded.  Useful  in  comparisons 
of  ground  vehicular  weapon  systems. 

FdURCE.  TRASANA  version  of  DIVOPS  with  extensive  rebuild  of  subroutines 
to  account  for  the  command  and  control  process;  totally  automated.  Mo- 
del development  is  currently  in  process  with  test  and  validation  due  for 
completion  CY77.  Documentation  is  incomplete,  but  the  model  is  intended 
to  include  sufficient  resolution  to  analyze  the  Division  Command  and  Con- 
trol system.  Current  test  and  production  is  in  support  of  CACDA's  CEATOS 
effort  Which  analyzes  Division  Command  and  Control  system  alternatives. 

TACOS  1 1.  Similar  to  COMMEL  in  many  aspects  but  reportedly  providing 
better  decision  algorithms  based  on  each  unit's  estimate  of  the  enemy 
situation  drawn  from  a normal  distribution  whose  mean  is  the  true  enemy 
location,  size,  speed,  ana  direction  with  a variance  related  to  the  qual- 
ity of  the  intelligence.  Combat  outcomes  depend  on  the  true  enemy  situa- 
tion and  the  applied  firepower.  If  it  operates  as  claimed  in  tne  docu- 
mentation, it  would  rank  high  among  all  models  surveyed;  TACUS  II  has  not 
been  located. 

None  of  the  above  models  appear  to  consider  the  pre-comoat  planning 
phase.  They  are  concerned  with  the  combat  process  and  the  possible  modi- 
fication of  the  plan.  Except  for  FDURCE,  none  in  their  present  state 
were  judged  suitable  for  evaluation  of  command  and  control  systems;  how- 
ever, FDURCE  is  in  the  process  of  development.  DYNTACS  and  CARMDNETTE 
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may  be  suitable  for  moaifi cation  to  account  for  the  Battalion  Commano  ano 
Control  system. 
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Bayesian  Analysis 
Dr.  Douglas  E,  Hunter 

Defense  Intelligence  School,  Defense  Intelligence  Agency 

HOW  TO  COOK  A BATES* 

INTRODUCTION 

Although  there  are  four  forms  of  Bayes  theorem  which  Intelligence 
an.ilysts  should  know  how  to  employ,  normally  usage  has  been  restricted  to 
the  simplest  form,  that  of  two  hypotheses  and  statistical  Irtdependence. 

This  probably  Is  the  case  partly  because  most  Intelligence  analysts  lack 
familiarity  with  the  various  forms,  and  partly  because  the  two  hypotheses  - 
statistical  Independence  form  Is  the  easiest  to  employ.  The  objective  of 
this  student-oriented  paper  Is  to  develop  a cookbook  appii>ach  that  will  enable 
a beginner  to  use  the  other,  more  general  forms  of  the  theorem.  Just  as  easily. 

This  objective  seems  of  particular  Importance  If  analysts  are  to  grapple 
with  more  complex  problems.  That  Is,  while  the  two  hypotheses  - statistical 
Independence  form  of  Bayes  may  be  highly  appropriate  for  some  l&W  (Indica- 
tions and  Warning)  problems,  such  as  the  one  where  hypothesis  may  be  that 
"Country  A will  attack  Country  B within  one  week"  and  the  second  (and  last) 
hypothesis  Is  that  "Country  A will  no^  attack  country  B within  one  week," 
many  problems  call  for  more  hypotheses.  One  might,  for  example,  be  faced 
with  a situation  where  hypothesis  is  that  "there  will  be  a large-scale 
attack  by  Country  A on  Country  B within  three  months,"  H2  Is  that  "there 
will  be  small-scale  provocations  by  Country  A against  Country  B within  three 
months,"  and  Is  that  "there  are  no  planned  hostilities  by  A against  B for 
the  next  three  months."  Trying  to  ftuce  this  situation  Into  the  two  hypo- 
theses mold  of  "attack"  or  "no  attack"  might  bo  highly  inappropriate.  We 
will  return  to  this  example  after  wo  present  the  four  forms  of  Bayos  theorem 
and  develop  a tabular  cookbook  approach  to  calculating  revlsod  probabilities. 

Let  us  turn  then  to  a statement  and  discussion  of  Form  I. 

*or,  "Recipes  from  the  Bayes  Cookbook" 
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FORM  1:  Any  number  of  hypothysesj  _st«tist_l_cal  dependence 

Tliis  Is  the  roost  general  form  because  It  places  no  limitations  on  the 
number  of  hypotheses  and  does  not  assume  statistical  Independence. 

The  formula  for  this  case  Is  very  long  and  complicated.  It  Is  given 
on  this  page  and  then  explained.  An  example  follows  the  explanation. 


Formulas  for  FORM  I 

Let  be  a set  of  "ffi"  mutually  exclusive  and  exhaustive 

hypotheses.  Then,  given  a sequence  of  "n"  events,  E ,E  .'■"E  , the 

12  " 

revised  probability  of  a given  hypothesis,  H^,  Is  given  by  the  formula 


p(H.l  • -Ae^) 


P(H^)-P(F.j|H^)-P(E2|H^AEj)--  PCE^lH^OEjOE^  •• 

^P(H^)-P(EJ  Hj)  -PCF.^  • - PfE^lHjAK^AE  A • • 


We  call  this  the  first  version  of  Form  I. 

A second  way  of  writing  this  same  formula,  which  is  probably  clearer 
to  a student.  Is  the  following  secemd  version  _of_  F_ojTn  _I. 

P(H.)-P(EjH.)-P(E2|HiAE,)---P(E„lHjOP,AE,n---nE  ) 

p /*  u I r r ~ — riAA^ 

^ 1»  1 * 2 ' P(hY)'-P('E  j ‘ ‘ ‘ ^n-1  ^ 

+P(H2)  • P(E^|  H^)  -PCE^I  H^AE^)  • • -PCEj^l  ' '^^n-l^ 

+P(H^)-P(E^|H^)-P(E2|H3AEj)--  -PfE^jH^OEAE^-  ••/JE^_^) 

+P(H^)  • P(eJ  H^)  -PCE^I  HJI  Ej)  • • -PCE^l  H/»E^Ep  • • ' AE^.j) 
There  probably  Is  still  some  question  in  the  minds  of  many  students 
about  such  things  as  the  subscripts  "i",  "n",  "m"  and  about  the  meaning 
of  the  that  Is  used  throughout  the  formula,  Tliose  symbols  will  be 

explained  now,  but  you  may  not  understand  the  formula  completely  until  you 
follow  on  through  the  first  example. 
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The  first  question  a stuilent  may  have  Is  what  Is  meant  by  writing 
list  of  our  hypotheses.  All  this  Is  saying  is 
that  there  are  "m"  hypotheses  In  number.  If  id»2,  there  are  only  two 


hypotheses,  and  H^.  If  there  are  four  hypotheses,  H^,  Hji  and  H^. 
The  use  of  the  three  dots  “••••'  in  "H  .H  " simply  means  that  we  have 

1 A ID 

left  out  the  listing  of  the  hypotheses  after  the  second  one,  l.e.,  , 

because  it  is  clear  what  we  are  doing,  that  is,  it  is  clear  that  we  are 

listing  one  hypothesis  after  another,  until  we  get  to  the  last  one,  which  Is 

V Tt  is  traditional  to  list  only  the  last  item  in  a list  after  the  three 

dots  So  we  list  H^,  the  last  hypothesis,  after  the  three  dots 

In  regard  to  the  list  of  events,  "E  ,£,,•••,£  *'  the  same  explanation 

holds.  All  we  are  saying  is  that  there  are  "n"  events  in  number.  If  n"l, 

there  Is  only  one  event,  E^.  If  n»2,  there  are  only  two  events,  E^  and  . 

If  n’A,  we  have  four  events,  E^,  E^,  E^,  and  E^.  You  might  ask,  why  not  let 

’’m"  be  the  last  term  in  this  list,  l.e.,  why  not  talk  about  "E,  ,E 

Tlic  reason  is  that  tliis  would  imply  that  there  necessarl  W were  as  many 

events  as  hypotheses,  since  we  used  "m”  to  list  the  inimber  of  hypotheses. 

So  we  pick  another  letter  to  stand  for  the  last  of  our  events.  It  may  be, 

by  chance,  that  in  a practical  example  we  have  as  many  events  as  hypotheses, 

but  by  using  this  symbolism  wltere  we  say  there  are  "m"  hypotheses  and  "n" 

events  we  allow  for  the  number  of  hypotheses  and  events  to  bo  different. 

hooking  at  the  expression  P(U,  ( E,(^E  ^ • ‘Oe  ) (located  to  the  left  of  the 

112  ^ 

"=•"  sign  in  the  second  version  of  Form  I),  the  first  thing  to  explain  Is  the 
use  of  the  term  H^.  Vflty  "i"7  Tlio  term  "H^”  stands  for  any  of  the  hypotheses. 

Tliat  is,  wo  arc  giving  a general  formula  that  will  tell  you  how  to  calculate 

the  revised  probability  for  any  one  of  the  hypotheses.  Tlius  "i"  can  be  any 
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number  between  "1"  and  ''m".  That  Is,  If  1-1,  we  use  the  formula  to 

calculate  We  do  this  by  replacing  all  the  ''l”s  everywhere  they  appear 

to  the  left  and  the  right  of  the  sign  by  the  number  ”1*'.  So  In  the 

numerator  of  the  second  version  of  Form  I,  for  example,  we  would  replace 

the  "i"  In  by  "I’'  and 

then  have  P(H  ) • P(E  I H ) • P(E  | H-Oe,  ) • • • P(E  ) H /lE /I  E rt  • • •/)£  ). 

1 11  ^ * 1 n ll2  n-1 

If  I'A,  to  give  another  example,  we  would  be  calculating  the  revised 

probability  of  H^,  l.e.,  P(H^^  E Ae^A- • '/^E^)  and  the  numerator  wovild  be 

P(HJ-P(E  \h  )-P(E^Ih  Ae,)- • -PCE  \ H f\E  nE/l- • AE  ).  In  the  expression 
^ 1 A 2'  « 1 n 4 1 2 n-1 

of  the  numerator;  P(H^)  • P(E^ I H^)  • P(E2 • • • P (Fj^l H^aEjOE2n • • •nEj^_j) , 

tlie  tliree  dots  "•••"  are  used  again.  Tlie  usage  once  more  means  that  It  Is 

clear  (hopefully)  how  we  are  listing  terms  so  that  after  the  first  few  we 

can  put  the  dots  "•••"  dowir  to  indicate  tliat  we  keep  on  listing  terms  until 

the  last  one  Is  reached.  Tlie  last  term  In  the  numerator  is"P(E  I H AE  f)E  A-  • "AF 

n'  1 1 2 n- 

and  It  too  uses  the  three  dots  to  Indicate  that  we  keep  listing  "E"s  until  we 
get  to  the  last  term,  E^.^  To  give  an  example,  if  n»l,  the  nuraer.itor, 

P(H^)-P(E^|  H^)-P(F_,(H^AE^)-  ••r{EjH.AKjAEp--  becomes  r(Hp-r(E^|  . 

If  n»2,  the  numerator  becomes  P (H. ) • F (E  | H, ) • P (E  ,l  H OE, ) . All  one  is 
doing  here  is  putting  down  "2”  evi-rywhere  the  "n"  appears  and  listing 
terms  until  the  last  one. 

If  we  have  n-*4,  the  numerator  becomes 
P(Hp-P(E^\H^)  P(E2|HpEp  riE3lHpE  AE^)  P(E^|HpKpK  /lE^) 

Since  in  practice,  of  course,  we  have  combinations  of  hypotheses  and 
events,  let  us  give  a few  examples  of  the  two. 

Suppose  ib»3,  n’A.  Tliat  is,  we  have  thioe  hypotheses,  H^,  and 
and  four  events,  E^,  E^,  and  E^.  If  we  want  to  ealenlate  the  revised 
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probability  of  tbe  second  hypothesis,  wo  would  have  to  the  left  of  the 
sign  nuiuerator  would  become 

PCH^)  • P (E^l  H^)  • P (E2 1 • P (E^l  H^nE^flE^ ) • P(E^|  E^O  E^OE^)  . 

Finally,  look  at  the  denominator  in  the  second  vej-sjon^  of  Form  I. 

You  can  see  that  the  denominator  Is  pretty  big,  but  each  term  should  now  be 
comprehensible  and  this  Is  the  version  of  Form  I that  you  should  use  In 
working  problems. 

Indeed,  the  difference  between  the  numerator  and  the  denominator  in  the 

second  verlon  of  Form  I Is  simply  that  the  numt'rator  is  but  one  of  the 

terms  (l.e,  rows)  of  the  denominator.  In  the  denominator  we  have  a tens 

(l.e.  row)  for  every  last  one  of  the  hypotheses. 

The  three  dots  between  the  term 

P(H^)-P(Ej^H^)-P(E2|H_j0r.^)--'P(Ej,|H^nE^nE2n---  E^_^)  and  the  term 

P(H  )-P(E  |H  )-P(E„|HOE  )-*-P(E  I H 0 E^^E  A • • -rtE  ) In  the  denominator 
m 1'  m 2'  m 1 n'  m 1 2 n-1 

Indicate  that  we  are  to  continue  listing  the  terms  (l.e.  rows)  until  we 
reach  the  one  for  "H  ”,  the  last  of  the  hypotheses. 

ID 

Let  us  turn  to  an  example  which  will,  hopefully,  clear  up  any  cematning 
confusion  a student  might  have  about  using  the  formula. 

Example : 


Suppose  that  we  have  four  hypotheses,  call  them  H,,  H , .and  H and 

1^3  4 

that  the  hypotheses  are  rovitually  exclusive  and  exhaustive. 

If  we  want  to  run  a Bayesian  analysis  we  start  off  by  assessing  sub- 
jective probabilities  for  the  first  Jbr^  hypotheses,  l.e,,  we  assess 
P(H^),  PCH^),  P(H_j).  Tlien  P(H^)  - 1 - lP(Hp  + P(H2)  + P(H3)]  since  the 
hypotheses  are  routu.illy  exclusive  and  exhaustive. 
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For  this  ex.imple,  suppose  we  decide  that  • 0.4,  PCH^)  * 0.2, 

P(H  ) - 0.1.  Then  P(H,)  - 1-0.7  - 0.3. 

3 

Next,  suppose  we  use  these  Initial  values  In  our  Bayesian  analysis  and 
that  we  wish  to  revise  the  probabilities  In  light  of  an  event  According 


to  the  formula  for  the  second  version  of  Form  I,  the  following  Is  true: 


P(HJE^) 


P(H2l  Ej) 


P(H^)-P(E^IHj) 

P(H3)-P(E  |h,) 

p/u  |c  \ s - - - — 

P(Hp-P(EjHp 

P(H^)-P(F.JHj) 

+P(H2)-P(eJh2) 

+P(H2)-P(eJH2) 

+P(H^)*P(eJh^) 

+P(H^)-P(eJh^) 

+P(H^)-P(eJ  h^) 

+P(H^)-P(E^|h^) 

P(H2)-P(E^IH2) 

P(H^)-P(E^1h^) 

, P(H^)-P(E  Ih  ) 

p(hJ  e ) - 

1 P(H^)-P(eJh^) 

+P(H2)-P(eJH2) 

P(H2)-P(eJ  H2) 

+P(H^)-P(eJh^) 

P(H3)-P(EjU3) 

+P(H.)-P(E  Ih  1 

4 14 

P(H^)-P(eJ H^) 

Strictly  speaking,  once  we  calculate  P(H^jEj),  P(H2|Ej^),  and  P(H-j|e^), 
we  can  calculate  P(H^|  Ej^)  by  the  formula  P(H^l  E^^)  = l-lP(Hj^|  E^)+P(H2l  E2)+P(H^1  Ej)  ] . 


However,  as  a check  on  all  our  calculations,  we  really  should  go  ahead  and 


calculate  P(H  I E.)  Just  to  make  sure  the  nviinbers  come  out  right. 

4 1 

Note  that  In  the  lormulas  for  P(hJ|Ej^),  PCH^Ie^),  P(H^|e^),  and  P(Hj 
the  denominators  are  all  the  same.  Only  the  numerators  vary. 


In  order  to  use  the  formulas,  we  now  must  assign  these  subjective 
conditional  probabilities: 
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P(E  |H,) 

1 2 

P(E^lH^) 

P(E  iH  ). 

X 4 

Tn  assigning  these  probabilities,  we  first  ask  ourself,  "What  Is  the 

probability  event  would  occur  IfWe  assume  (l.e.  given)  hypothesis  to 

be  true"  In  order  to  assess  P(E  |U  ).  Next  we  ask  ourself,  "What  Is  the 

l'  1 

probability  event  E^  would  occur  If  we  assume  (l.e.  given)  hypothesis  H2  to 

be  true"  In  order  to  assess  PCE^jH^).  We  continue  to  ask  the  same  sort  of 

questions,  assuming  to  be  true  In  order  to  assess  P(Ej^jH^)  and  then 

to  be  true  in  order  to  assess  P(E,|h,). 

1 4 

Suppose  we  decide  on  the  following  probabilities: 


P(E^Ih^)  - 0.8 
PCE^IHj)  - 0.9 
P(E^Ih^)  - 0.4 
p(eJh^)  - 0.5 

Note  that  there  is  no  need  for  these  probabilities  to  add  up  to  "1". 

Once  these  values  are  assigned  wc  simply  plug  them  Into  our  equations. 

In  this  case,  we  get  the  following  results: 

P(Hj)-P(E  |h  ) 

P(HJEi)  - p(-H-)'.y(¥^t¥j 

+P(H2)-P(E^|H2) 

1-P(H^)-P(E^|H^) 

>P(H,)-P(E  IH  ) 

14 

_ (0^4)(0.81_ 

'(0.4)  (O'.  8) 

K0.2)(0.9) 

+(0.1)(0.4) 

->■(0.3)  (0.5) 
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- 0.32_ 

0.32 
+0.18 
+0.04 
♦0.15 

0.3^ 

“ 0.69 

• 0.464 


Since,  as  noted  before,  the  denominators  are  all  the  same  for  P(Hj^lE^), 
**^*^2^^!^'  simply  write: 

P(H,)-P(E  Ih.) 

P(HjIex>  --^0.69 


(0.2)(0.9)  0.18 


0.69 


0.69 


0.261 


P(H3| Ej) 


P(H3)-P(E^jH3) 
0.69'~  ■■■ 

- .(oa.UO-A).  - 0-P4  . 
0.69  0.69 


P(H  Ie  ) V ^ (0. 3X0.5)  0,15 


0.217 


So  the  results  are: 

P(Hj^lEj^)  - 0.464 
PCH^IEj^)  - 0.261 
PCH^jE^)  - 0.058 
P(H  1e  ) • 0.217 

4'  1 

1.000 

and  the  results,  that  is,  the  revised  probahll It ies,  add  to  "1"  .is  they 
should. 
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Tluis  far,  to  tabulate  our  results,  we  have: 

TABl.E  I 

P(H^)  - n.i  prv 

PCH^) 

P(H  ) 

Suppose  now  that  event  occurs,  and  we  wish  to  calculate  our  revised 
probabilities  In  light  of  the  latest  evidence. 

According  to  the  second  version  of  Form  1,  we  wish  to  calculate: 


0.4 

p(eJh^)  - 0.8 

P(HilE^)  - 0.464 

0.2 

PCE^lH^)  - 0.9 

PCH^Ie^)  - 0.261 

0.1 

P(eJH3)  - 0.4 

P(H3|E^)  - 0.058 

0.3 

P(E^|H^)  - 0.5 

P(H, Ie  ) - 0.217 
4'  1 

KH  1-P(E  |h  )T(E  |h  Oe  ) 

Pdiji-op-p  - ' 

11  1 2 P(Hj)-P(E^1h^)-1’(K21h  He^) 

+P(H.)-P(E^|H2)-l'(E2|H^nE^) 

+ P(H^) • P(E^|  H^) -PCE^I  H Oe^) 
+P(H^)  • P(F.^|  H^)  • P(F.^1  H^Oe^) 

p(h,)-p(e,|h  )-P(E  IH  He,) 

2 1 2 P(H^)-P(E^iH^)-P(E2lH  OE^) 

fP(H2)-P(F^|  H^)-P(E^|  H2^E^) 

+p(h^)-p(e^|h^)-p(E2I 

+P(H  )-P(E  IH  1-P(F  I H nP.,) 

4 I A 2 A i 


P(H3)'P(eJh^)-P(F2|H^OE^) 

P(H^)-P(EjH^)-P(F2|HjnE^) 

P(H2)*P(E^|H2)-P(F2lH2nE  ) 

P(H,)-P(F  |h  )-P(F Jh  OE  ) 
3 13  2 3 1 

P(H^)'P(E^|H^)-P(EjH^nE^) 
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P(H^\F^nf2>  - - ^ - ^ A...  2'-A-i_ 

P(H^)'PU:i|H^)-r(E,lH^nE^) 

P(H  )-P(E  |h  )P(E  In  Ae  ) 

2 1 2 2 7 1 

P(H^)-P(EjH^)-P{E^|HyiEp 

P(H,)-P(E  IH  )-P(E  |h  ft) 

A 14  2 I,  1 

As  a I'lu'^  k on  ovir  raU'ulat  ions , we  should  ciilculdte  P(H  Ie  Oe  ) as  well 

4*1  2 

as  the  other  p roh.thl  1 1 1 les . 

Note  again,  that  all  the  denomi nat ors  in  the  above  equations  are  the 
s.ime.  Only  the  numerators  differ. 

In  order  to  use  the  formulas,  we  now  must  assign  these  subjective 
condit  Icinal  probabillt  ies: 

PIE^IHjOe^) 

P(E2l«2^E^) 

PCE^lH^flE^) 

P(E2(H4nEi), 

In  assigning  these  conditional  probabilities,  we  first  ask  ourself, 

'Vliat  is  the  probability  that  event  E2  would  occur  if  assume  (l.e.  given) 

hypothesis  to  be  true  and  if  (i.e.  given)  event  has  occurred"  in 

order  to  assess  PCE^IH^De^).  Next,  we  ask  ourself,  'Vliat  is  the  probability 

event  E^  wo\ild  occur  if  wg  assume  (i.e,  given)  hypothesis  to  be  true  and 

if  (i.e.  given)  event  E^  has  occurred"  in  order  to  assess  P(E2lH2nE^).  We 

continue  on  to  ask  the  same  sorts  of  qviestions,  first  assuming  to  be  true 

and  Ej^  to  have  occurred  in  order  to  assess  PCE^lHyiE^)  and  next  assuming 

to  be  true  and  E,  to  have  occurred  in  order  to  assess  P(E  I H Oe  ). 

1 2 4 1 


Suppose  we  decide  on  these  values: 


I’CE^nmE^)  - 0.2 

PCE^IH^HE^)  - 0.8 

PCE^lH^rtE^)  =0.6 

I’CE-lHOE  ) = 0.3 
^ A 1 

Note  again  that  there  is  no  need  for  these  values  to  add  up  to  ”1", 
Once  these  values  are  assigned  we  simply  plug  them  Into  our  equations 
To  make  our  calculations  easier  to  follow  we  will  first  repeat  all  the 


values  wo  have  assessed  so  far. 


TABLE  II 


P(H^)  = 0.4  P(EJH^)  = 0.8  PCE^lHj^flE^)  - 0.2 

P(H^)  = 0.2  PCE^lH^)  = 0.9  P (E^l  H^rVEj^)  - 0.8 

P(H  ) - 0.1  P(E  IH  ) = 0.4  P(E-lHnE  ) - 0.6 

■»  1 3 2 3 1 

P(H  ) “ 0.3  P(E  iH.)  = 0.5  P(E,|H,nE  ) - 0.3 

4 1 ^ 2 A 1 

Taking  those  values  then,  we  can  plug  the  numbers  into  our  formulas. 


P(EJH^)  = 0.8 

PCE^IH^)  = 0.9 

P(E  IH  ) = 0.4 
1 3 

P(E  IH.)  = 0.5 
1 ** 


We  get: 


P(n^l  e^AEj) 


P(H^)-P(E^|H^)-P(E2lH^nEj^) 
P(H^) • P (E^I H^) • P (E^l H^OE^) 
+P(H2)-P(E^|H2)-P(E^|h/1Ej) 
+P(H3)*P(EjH3)P(E2|H3nE^) 
4P(H^)-P(E3|H^)*P(E2ln^nE^) 


(0._4)(0.8)(0.21 

(0.4)(0.8)(0.2) 

+(0.2)(0.9)(0.8) 

+(0.1)(0.4)(0.6) 

+(0.3)(0.5)(0.3) 

0.064 

‘ b'.'064'  + oViaV  + 0.024  V ().045 


Noting  again  that  since  the  denominators  In  the  equations  for  calculating 
E^riE^) , PCH^I  E^flE^) , PCH^E^rtE^),  P(H^1  E^OE^)  are  the  same,  we  can 


simply  write: 


0.277 


(0.2) (0.9) (0.81 
■ 0.277 

0J41 
“ 0.2  '77 

- 0.520 

P(H  )-P(E  IH  )-P(E  Ih  Oe  ) 

P(H3|E,0EP  • 


. (0.1)(0.4)(0.61 
0.277 


0,021 

" O.Y77 

- 0.087 

P(H^)-P(E^|h^)-P(E^ 

'’(H4l^l0£2>  0.27>- 

_ (0.3) (0.5) (0.31 
■0.'277 


0.041 

“ ■0  . Y77 
- 0.162 


So  the  results  are: 
P(H^Ie^0E2)  - 0.231 
P(H2lE^f»E2)  - 0.520 
PCH^IEjOE^)  - 0.087 
P(H  IeOE,)  - 0.162 

^ ^ 2 y;ooo 
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and  the  results,  that  Is,  the  revised  probabilities,  add  to  "1"  as 
they  should. 


At  this  point  the  reader  may  have  noted  something  very  Interesting. 

If  you  look  back  at  Table  II,  then  you  can  see  that  the  dein'ininators  we 
just  calculated  were  just  what  you  would  get  if  you  multiplied  tlie  entries 
together  for  each  row  In  Table  II  and  added  up  the  results,  book  at  the 
denominator  In  the  equation  for  PCH^I  K^0K2)  followlnp  Table  11.  It  mateties 
the  array  wc  set  out  In  Table  II,  l.e.,  each  term  (l.e.  row)  In  the  denomi- 
nator matches  a corresponding  row  In  tlie  table. 

As  for  the  numerators  we  just  calculated.  If  wo  want  the  revised 
probability  of  any  hypothesis,  the  mniu'r.tlor  comes  from  multiplying  the 
entries  together  for  the  row  In  Table  11  that  C4>rii'sponds  to  t lie  hypi'lhesls 
of  Interest.  For  example,  wc  get  the  numerator  for  I’lH^I  from  the 

third  row  entries  of  Table  II  - compare  to  the  actual  calculation  we  made 
for  P(Hj|EjnE2)  to  verify  this. 

All  this  Is  very  Important,  because  it  nn'ans  that  wo  can  simply  pUig 
our  entries  Into  a table  and  multiply  out  the  rows  and  add  up  the  resvilts 
In  order  to  calculate  the  denominators,  Aity  nuraiMator  for  a given  hypi'thesls 
comes  from  the  corresponding  row  for  that  hypothesis,  l.et  us  do  this  ft'i  the 
following  example. 

Suppose  we  keep  on  with  the  prevlovis  case,  btit  now  have  four  even’s. 

We  have  to  assess  the  following  entries  for  a table: 
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ri.^> 

TAIII.C  III 

Ptr^lB^aE^fli^) 

Hew 

fioduct 

Kt^lB^nijl-o.: 

r(tj|Hjnr^Ej)-o.6 

PtE^lBj/lljOE^Ejl-O.! 

0.0I1S2 

r(r^lHy»£^)-o.i 

Krj|BjAE^rtEj)-0.7 

nrj  H^tiEjOE  ntj)-o.6 

0.060AB 

rttjl  Bj)-o.* 

KtjlBjOt  Oe^)-0.1 

p(tjBjfttOEprj)-o.i 

O.OOOAB 

r(B^)-o. j 

Kt  |B.)-0.» 

riilB  nt,)-o.  j 

PtEjlH^ntjOE^l-O.J 

p(E  1 B ftE,nE,nr.)-o.* 

0.0202^ 

1 • 

J 4 i 

4 9 i 2 J 

0.09273 

To  verify  thrtt  this  nrray  reslly  correspoiuls  to  the  entries  In  the  second 
version  of  Form  I,  look  «t  that  eijnatlon  and  svihstltxite  In  id'*A,  n»lt.  It 
should  be  clear  that  each  row  of  Table  IT  corresponds  to  a row  of  the 
denominator  of  the  second  version.  The  row  products  In  Table  HI  correspond 
to  the  valvies  of  the  terms  (l.e.  rows)  In  the  di'nomlnator  of  the  second 
version. 

Using  the  table,  since  the  sum  of  the  row  prodviets  Is  0.0*^273,  we  have; 

P(H,lE,AK,nK-0E,  ) - lAl  - 0.124 
1 i ^ 3 ^ 0.09273 

P(H^\e  AK^OE/lE^)  - - 0.652 

P(H^lE^nE  AeHE^)  - - 0.005 

P(H^\E  AE^OE^E^)  - - 0.218 

0.999 

Onr  snra  for  the  revised  probabilities  Is  essentially  *'l"  as  It  shov>ld 

be. 

Tills  sort  of  tabular  approach  to  Bayes  greatly  simplifies  calcnlat Ions. 

One  simply  lists  ns  iminy  rows  ns  there  are  hypotheses.  The  first  column 
will  be  the  initial,  or  prior  probabilities  assessed  for  the  probabilities  of 
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the  hypotheses.  The  following  columns  correspond  to  the  entries  assessed 
as  the  events  occur.  If  as  In  the  above  example,  one  simply  fills 

in  the  appropriate  entries  - what  Is  appropriate  Is  quickly  clear  from  so 
examination  of  the  denominator  of  the  second  version  of  Form  I. 

This  tabular  approach  allows  us  to  easily  carry  out  a sensitivity 
analysis  of  our  figures.  It  is  easy  to  keep  straight  what  we  are  doing. 

KOFW  JI_j-  An^  of_l^pqthc^s ; statjstlcal  independence 

Tills  form  differs  from  Form  I In  that  we  assume  statist  leal  independence. 
Again,  the  formula  is  somewhat  long  and  complicated,  but  as  will  be  seen 
in  a moment  it  is  very  similar  to  Form  I and  permits  the  same  sort  of 
tabular  solution 

Formulas  for  FORM  11. 

Let  H,,  H,,  •••,  H be  a set  of  *'m”  mutually  exclusive  and  exhaustive 
12  o 

liypotheses.  Then,  given  a sequence  of  "n”  inde_pen<^n^  events  Ej,  E^ 

the  revised  probability  of  a given  hypotheses,  is  given  by  the  formula: 

P(H^)  -PfE^l  H^)  -PIE^I  * • ’PCEJ  »!> 


^P(Hj)-P(Ei|  Hj)-P(E2|H^)---P(EjHj) 


Again,  a second  way  of  writing  this  same  formula,  which  is  not  only 
probably  clearer  to  the  student  but  also  lends  itself  to  a tabular  arrange- 
ment can  be  given.  We  will  call  it  the  second  ve^rslon  of  FORM  11.  It  is  as 
fol lows : 

P(H^) -PfE^l  H^) -PfE^l  H^) • • -PfE^I H^) 

P(H^)  -PCKilH^)  -PfF.^I  • • -PCE^lH^) 

+P(H2)-P(F.^|  H2)-P(E2(H2)---P(EJH2) 

+P(H^)  PCeJ  Hj) -PCEjIHj) • • -pCeJ  Hj) 

+P (H„)  • P (E^»  1W  XEil  V • • P (Fj  H„) 

;i7 


PCH^lE^Eyl-'flE^)  - 


[■ 

r«' 


J 


Th*  major  difference  between  this  second  version  of  Form  II  and  the 
second  version  of  Form  I,  from  the  user's  point  of  view,  comes  In  the  way 
one  phrases  the  conditional  probabilities  to  be  assessed. 

For  example,  _1  n_st  of  assessing  (l.e.  assigning  a subjective  proba- 
bility to)  P(,K^l  as  we  had  to  do  In  the  second  version  of  Form  I,  we 

now  assess  PCE^Ih^)  and  ask  ourself,  "What  Is  the  probability  that  event  Ej 
would  occur  if  we  assume  (l.e.  given)  hypotheses  to  be  true."  No  attention 
Is  paid  to  the  occurrence  of  Also,  it  clearly  makes  no  difference,  as  to 

the  probability  assessed,  in  what  order  we  consider  the  events. 

TTie  s.ame  sort  of  tabular  approach  used  before  can  be  used  here  to  solve 
for  the  revised  probabilities.  Suppose  we  have  five  hypotheses  and  four 
events.  Suppose  we  have  assigned  these  subjective  probabilities: 

TABLE  IV 


P(Hj) 

P(EjH^) 

PCE^lH^) 

P(E3|Hj) 

P(Ej  Hj) 

Row 

Product 

P(H^)-0.10 

P(EJ  H^)-0.5 

P(E2|H^)=0.9 

P(E^|h^)-0.1 

P(E  IH  )-0.7 

H 1 

0.00315 

P(H2)-0.05 

p(eJ  H2)-o.3 

P(E2|H2)“0.8 

P(K3lH2^*°-2 

PCE^jH^J-O.S 

0.00192 

P(H^)-0.15 

P(Eil  H^)-0.A 

P(E2lH^)»0.A 

P(E^|  H^)-0.3 

P(E^(H3)-0.1 

0.00072 

P(H,)-0.30 

A 

P(E^lH^)-0.2 

P(E  1 H )-0.2 

A A 

0.0002A 

P(H3)=.0.A0 

P(E^|  Hj)-0.9 

PCE^I  H3)-0.2 

P(E3|H^)-0.2 

P(E^jH3)-0.9 

0.01296 

0V018'99 

So  the  denominator.  In  any  of  the  equations  to  solve  for  the  revised 


probabilities.  Is  0.01899. 

To  solve  for  P(H  Ie/IeAeAe  ) we  have 
1 1 2 3 A 
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P(Hi|  E^AE2AE:^E^)  - 0701899  “ 0*166 
PCH^IEjAe^^^E^/Ie^)  - oToisW  “ 0.101 
P(H^  E^AE^OE^E^)  - 0,0*1899  “ 0.038 
PCH^UnE/lEnE^)  - . 0.013 

PCH^lE^OE^E/lE^)  - 

1.000 

And  again,  the  revised  probabilities  add  to  "1"  as  they  should. 
After  a while,  In  using  the  tabular  arrangement,  one  might  simplify 
it  and  write  it  this  way,  for  example: 

TABLE  V 


P(Hj) 

p(eJh^) 

P(E^lH^) 

P(E3|H^) 

P(EjH^) 

Row 

Product 

0.1 

0.7 

0.6 

0.1 

0.6 

0.1 

0.000252 

0.7 

0.5 

0.2 

0.2 

0.7 

0.4 

0.003920 

0.1 

0.9 

0.7 

0.7 

0.8 

0.9 

0.031752 

0.05 

0.1 

0.4 

0.9 

0.1 

0.7 

0.000126 

0.05 

0.3 

0.3 

0.8 

0.2 

0.6 

0.000432 

0.036482 

That 

Is,  once 

you  get  used 

to  using  the  tabular 

arrangement 

, you  can 

Just  say  to  yourself  what  entry  you  are  putting  Into  a given  cell,  e.g., 
P(E^|h^)  =»  0.8,  but  you  Just  put  down  the  0.8. 

PORM  III;  2 hypotheses;  statl st leal  d epende nee 

In  contrast  with  the  previous  cases,  the  formulas  here  are  quite  easy. 
Because  the  tabular  arrangement  here  Is  so  easy,  we  prefer  not  to  present 
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the  usual  "odds  - likelihood"  form  of  Bayes  Theorem.  Also,  the  "odds  - 
likelihood"  form  does  not  lend  Itself  quite  as  easily  to  sensitivity 
analysis,  in  our  opinion. 

Formulas  for  FORM  III. 

Let  and  H2  be  two  mutually  exclusive  and  exhaustive  hypotheses. 

Tlien,  given  a sequence  of  "n"  events,  £2*  the  revised  probability 

of  a given  hypothesis,  H^,  Is  given  by  the  formula: 

P(H  )-P(E  |h  )-P(E jHnE,)---P(E„|H/^E,/lEyi--'OE  ,) 
i*  n'  P(H^)  -PCE^l  H^)-P(E^'l  • • •PdfJI  npEpYp  - • 

P(H2)  -PCEj  H2)  •P(E2|  H^E^)  • • -PCEJ  H2/1e/1E20  • • 

In  this  formula,  "1"  can  only  take  on  the  values  "1"  and  "2"  since  there 
are  only  two  hypotheses,  and  H2. 

Note  that  once  we  assess  P(H^),  It  follows  that  P(H2)  “ l-P(H^)  since 
the  hypotheses  are  mutually  exclusive  and  exhaustive. 

To  give  an  example  that  uses  the  usual  table  format,  suppose  we  have 
n»5,  and  that  we  make  the  assessments  shown  here: 

T*bl(  tj 

Ki,|ij)  rtejli^hij)  FCtjUntjOi,) 

r(tj|Njn*j)-o.»  P(£jIiine/>ej)-o.*  o.omM 

r(^J|ly^eJ)-o.J  ntjlapi^ntp-o.t  nt^\aptptptp-o.$  r(tj  aptptptpkp-c.$  c o:iw 

O.OMtM 

So  our  denominator  Is  0.053760.  Then 

p(h,|e  AeAe  Ae  Ae.)  - - 0.6 

^ 1 2 3 A'  5 0.053760 

P(H,\e  Ae  Ae^E.Ae.)  -'P.-P.2V50A  - 0.4 
2‘  I 2 J 4 5'  0.053760  

1.0 


p(i]) 

r(Hj)-o.* 
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Once  more  the  revised  probabilities  add  to  "I”  as  they  should. 

This  formulation  can  be  put  In  a tabular  form  that  is  almost  as  fast 
as  the  "odds  - likelihood"  form,  and  is  better  suited  for  a sensitivity 
analysis. 

For  example,  taking  the  data  In  Table  VI  above,  let  us  compute  the 
revised  probabilities  as  each  piece  of  data  comes  along.  We  will  use  this 
format: 


J 

P(H^) 

P(Ejl  Hj) 

Row  Product 

Revised  Probabilities  for 

1 

0.6 

0.3 

0.18 

'■‘"I'VbvH--'’” 

2 

0.4 

0.7 

0.^ 

fWiiv  p--‘i 

0.46 

1.00 

the 

next  piece 

: of  data  we 

have: 

J 

P(Hj) 

P(EllH^) 

PCE^IHjOe^) 

Row  Product 

1 

0.6 

0.3 

0.8 

0.144 

2 

0.4 

0.7 

0.3 

0.084 

0,228 


PCHJ  . P.;A“  - 0.63 

Kh^IEjAEj)  - £;P«A  . p.^ 

1.00 


For 

the  next 

piece  of 

data  we  have: 

j 

P(Hj) 

P(EJ  Hj) 

P(E^|HjnE^0E2) 

Row 

Product 

1 

0.6 

0.3 

0.8 

0.8 

0. 

1152 

2 

0.4 

0.7 

0.3 

0.4 

0336 

0. 

1488 
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Note  that  we  can  take  our  latest  entry  In  row  1,  namely  "0.8,”  and 
multiply  It  times  the  row  product  for  the  previous  calculation,  namely 


"0.144,"  to  get  our  latest  row  product  of  "0.1152,"  This  sort  of  process 
greatly  speeds  up  the  use  of  the  technique.  For  this  latest  event  we 
calculate : 

■ SvuW  • 

P(Hj  H - P,.23 

l.OO 

Finally,  for  the  latest  event  we  have,  using  the  shortcut  suggested 
In  the  last  paragraph: 

J Previous  Product  Row  Product 

1 0.1152  0.7  0.08064 

2 0.0336  0.8 

0.10752 

So  P(H,|  E,0e/)e/)e,)  - - 0.75 

i'  i ‘ ^ ^ 0.10758 

P(H,I  e/)e  OE.rfe  ) - P.-PPPP^  - 0.25 
2'  1 2 3 4 0.  10752  

1.00 

After  one  becomes  used  to  the  process  one  could  build  an  even  shv^rter 


arr.angeraent . 

For  example,  to  do  the 

calculation  for  E^,  we  could  have  this 

format : 

r revlous 

J Product 

^(^31  Hj0Ei/\E2^E^Ae^) 

Row 

Product 

Revised  Probabilities 
for  Hj 

1 0.08064 

0.4 

0.032256 

0.053696 

2 0.02688 

0.8 

p.0_21l4^ 

0.021440 

0.053696  - 

0.053696 

1.00 

3RM  IV;  2 hypotheses;  st at Istlcal  Jn d ej>e n d ence 

The  simplest  form  of  all,  and  the  most  used,  this  has  a formulation  very 
similar  to  the  previous  one. 

Let  and  be  two  mutually  exclusive  and  exhaustive  hypotheses.  Then, 

given  a sequence  of  "n"  Independent  events,  E, , E«,  ••*£  , the  revised 

12  n 

probability  of  a given  hypothesis,  H^,  Is  given  by  the  formula: 

I A A PCH  ) P(E  Ih  )-P(E  |H  )•••?(£  I H ) 

H.\£A£A---Ae  ) - --A 1-A 2.. A P_JL 

i 1 2 n P(H^)'P(E^1Hj^)-P(E2(Hj)'**P(EJH^) 

+P(H2)  -PCE^I  Hj)  -PCE^I  Hj)  • • -pceJ  h^) 


P(H, 


Again,  "1”  can  only  take  on  the  values  "1"  and  "2"  since  there  are 
only  two  hypotheses,  and  H^. 

Note  again  that  once  we  assess  P(Hj^),  It  follows  that  P(H2)  “ l-P(Hj). 
A tabular  arrangement  similar  to  the  previous  one  makes  calculations 
go  very  rapidly. 

Ve  can  start  off  this  way: 


J P(Hj) 

P(£llH^) 

Row  Product 

Revised  Probabilities 

for  H 

1 0.65 

0.3 

0.195 

P.-A^l  - 0.44 

0.440 

2 0.35 

0.7 

0.245 

P-AAl  - 0.56 

0.440  

0.440 

l.OO 

For 

the  next  event,  E^,  we 

would  have: 

Previous 

P(E2IHj) 

J 

Product 

Row  Product 

Revised  Probabilities  for 

1 

0.195 

0.8 

0.1560 

- 0.68 

0.2295 

2 

0.245 

0.3 

0.0735 

P.:.0735  , 0 32 

0.2295 

0.2295 

1.00 
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For 

the  next  event 

E^,  we  would 

have 

j 

Previous  Product 

P(E  Ih  ) 

3 j 

Row  Product 

Revi sed 

Probabilities  for 

1 

0.1560 

0.8 

0.1248 

0.1248  _ 
0.1542 

0.81 

2 

0.735 

0.4 

0,0294 

0.0294  . 
0. 1542 

0.19 

0.154^ 

i.oo" 

I 

I 

J 
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KKAMPLE 


Now  that  we  have  presented  the  four  forms  of  Bayes  theorem  and  the 
tabular  cookbook  approach  for  quickly  calculating  the  revised  probabilities 
let  us  return  to  the  three  hypotheses  example  mentioned  in  the  introduction 

Let  “ Tliere  will  be  a large-scale  attack  by  Country  A on  Country  B 
within  three  months, 

• There  will  be  small-scale  provocations  by  Country  A against 
Country  B within  three  months, 

“ There  are  no  planned  hostilities  by  A against  B for  the 
next  three  months. 

Suppose  that  we  have  assigned  the  Initial  probabl 1 it les  of  P(Hj)»0.2, 
P(H2)»0.6.  Tlien  P(H^)-0.2. 

Next,  suppose  that  Ej  is  that  A has  secretly  ordered  a reserve  army 
division  to  be  mobilized  as  rapidly  as  possible.  Suppose  further  that 
A has  a total  force  of  four  active  and  eight  reserve  divisions  and  B a 
force  of  six  active  and  eight  reserve  divisions,  Using  our  tabular 


arrangement. 

we  might  iMke 

the  following 

assessments  and  calcvilat  ions . 

i P(Hj) 

PfE^I 

Row  Product 

Revised  Probabilities  for 

1 0,2 

0,7 

0,16 

0.14  „ 

0.*66  ’ 

2 0,6 

0,7 

0,42 

0.«2  „ 

0,66  ’ 

3 0,2 

0,5 

p.J^ 

0.10  ^ 

*0,66  “ 

0,66 

1,00 

Next  suppose  that  E^  is  that  Country  A's  array  chief  of  staff  has 
visited  Coxintry  C,  which  is  an  ally  of  A’s,  and  also  has  a border  with 
Country  B,  Again,  using  our  tabular  arrangement,  we  might  have  the 
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following  assessments  and  calculations,  where  we  assuroe  statistical 
dependence. 


J 

Previous  Product 

PCE^IH^AEj) 

Row 

Product 

Revised 

Probabilities  for  H 

1 

0,14 

0,9 

0,126 

0,126 
0.'35'6  “ 

0,35 

2 

0,42 

0,5 

0.210 

0,210 

0 .'35'6  “ 

0,59 

3 

0,10 

0.2 

0,020 

0,020 
'0  .'3'56  ” 

0,06 

0,356 

1,00 

Next,  suppose  that  Is  that  Country  A has  announced  that  it  will  be 
holding  Its  annual  army  imineuvers  on  time  In  the  second  of  the  three 
months  covered  In  the  hypotheses.  The  maneuvers  this  year,  however,  will 
be  near  the  natural  Invasion  route  Into  Country  B,  Maneuvers  have  not 
been  held  there  for  the  last  10  years,  largely  because  when  they  were  held 
there  ten  years  ago,  the  result  was  a major  protest  by  Country  B and  a 
general  souring  of  relations  that  has  continued  to  the  present  time. 

Again,  using  our  tabular  arrangement,  we  might  have  the  following 
assessments  and  calculations! 


Row  Revised 


J 

Previous  Product 

P(E3)  Hy^E^OE^) 

Product 

ProbaV 

>11  It  iei 

1 

0,126 

0,9 

0,113 

0,113 

b’,'29T 

» 0,39 

2 

0,210 

0,8 

0,168 

0,168 

072*91 

- 0,58 

3 

0,020 

0,5 

0.01£ 

0,010 

0,291 

’ o.j^ 

0,291 

1,00 

At  this  point,  after  three  items  of  evidence,  our  estimate  of  the 
probability  of  a large  scale  attack  has  almost  doubled,  going  from  0,2 
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to  0.39.  The  probability  of  small  scale  provocations  is  almost  the  same, 
going  from  0.6  to  0,58,  The  probability  of  no  hostilities  has  declined 
from  0,2  to  0.03,  So  some  form  of  conflict  is  extremely  likely. 

We  could  go  on  with  this,  but  the  point  really  was  to  show  how  easy  it 
is  to  use  the  tabular  arrangement  in  recording  subjective  probability 
assessments  and  in  calculating  revised  probabilities  of  hypotheses. 
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rrn.i;:  a ;;oi"1v;aki’  i’ost  istimatini;  'n'rHNii.'nr  roK  tommi 'nidations  systims 

Al'THOK:  STAN  IH'NN 

Al'STKA^’T:  A ■■I'llw.iit’  ii'sl  r'U  i m.t  I \ ii'i  t I'l  hn  i ' (ui ' i ■>  pi  c.i-nt  i\t  toi  l.iiip" 

si-.ili'  i-omnum  w Ml  u'tis  sysItMiis.  A moit  i I i imI  m'lphi  MppioMili  1 1\  > I'lniiiirl  i >'n 
with  ,1  Si'llwMii'  »\v.l  I'stiiHMlinii  iiH'ilrl  i , iisi'il  li>  mitivi-  mI  m piin>'ipMl 
(•Oil  1':.  t 1 HIM  I 1' . Till'll,  liiu'  ti'  I hi'  lii'lni  1 1'Vi;.  iiMluir  I'l  '.I'Mwni'  lii’Vi' K'pmi'iil  in 
I'l'iiipii'x  sysli'ins,  m iisK  MiiMlysi:.  iiii'ili'l  i •,  u:,i',)  l,i  i Iim  i mi  ■ I n i i /i'  I hr  hiiih 
ii'iK  r 1 1'liirnt  msmih- i Ml  I'll  wilh  m >|i'iiri  ,i  1 i .-.nl  ri'miiiiiii  i rM  I i mr-  i.y.lriii.  Thr  iriMill 
I'l  I hr  link  Miuilysl.'i  Mir  I hrii  Mppllril  In  I hr  piiiirip.il  rr;.l  i".lim.ilr  in 
oiilri  lo  .iiiivi'  .il  .1  I'list  rntiili.ilr.  Allri  ilrvr  1 op  i ini  .i  lrrhni>|iir  wliirli 
pioviiirs  .1  rml  rstiiii.ilr  l.iilririi  Ir  ,i  '.prrilir  pirirrl,  bill  nrl  l.illrir.i 
to  .my  p.lilU'ul.U  ilrvrlopri,  .l  srroiul  trrhniiiur  i '.  pi  ri.rnl  rii  wliirli  ilriivi". 

M I'lls  I omi  I’.ril  rosi  rstiiii.ilr.  Thin  l .irroiiip  1 i i.tirii  Ihioii.ili  I In-  U'm'  oI  ir- 
iirrssion  .m.ilysis  b.r.i'il  on  pr  rv’ 1 1 I y <'•  limili'il  nollw.iir  .Irvr  1 opiiir  nl  .o.l'. 

.iiui  i.rlu'iln  1 rs . In  .niilition,  thr  i i sk  .m.ilysi';  iii.'.irl  in  i r inn  with  I hr  hinh- 
ilsk  rli'nirnt.'i  .iiiiiisloil  lo  ii'llrrl  I hr  r.ip.ib  i 1 i I i r ••  ot  .i  '.proilir  ilrvrlopri. 

Thr  irnnltn  ot  thr  trijirssion  ti'rhniiinr  .mil  I hr  .iilni'.lr.i  i i sk  .in.ily.is  Irrh- 
nbinrs  .iir  thru  rombinrii  Ui  rsl.iblish  .i  ro'.l  i".liiii.ilr  l.iiloiril  lo  U't  h I hr 
pro  ii'ot  .iiiil  thr  itrvrlopri  ot  thr  'lollw.iir. 
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A SOFTWARE  COST  ESTIMATING  TECHNIQUE 
KOR  COMMUNICATIONS  SYSTEMS* 

STAN  DUNN 

U.  S.  ARMY  COMMUNICATIONS  COMMAND 


Tliere  is  no  universal  method  for  estimatinq  tiie  costs  of  software.  In 
actuality,  attempts  to  make  these  estimates  have  been  far  from  adequate. 

It  is  not  unusual  to  find  projects  in  both  qovermnent  and  business  costing 
10  times  tlie  original  estimate  and  two  to  tliree  times  is  common'. 

There  are  several  factors  which  complicate  estimating  the  cost  of  soft- 
ware development: 

1)  Software  development  is  largely  an  iterative  process  in  a complex 
system  caused  by  engineering  changes,  technology  advances,  etc.,  which 
historically  impose  changes  in  software.  Also,  work  completed  on  a process 
step  may  have  to  be  repeated  because  of  later  developments  in  the  process. 
For  example,  the  failure  of  a program  to  pass  an  integration  test  will 
require  repeating  some  part  of  the  program  design,  code,  and  test  step;  or 
the  systems  analysis  and  design  step;  or  both.  This  recycling  within  the 
programing  process  is  widely  recognized  as  a major  factor  in  both  the 
magnitude  of  total  costs  and  the  uncertainty  of  predicting  programing  costs. 

2)  Secondly,  software  development,  as  a field,  is  very  new  and  has  been 
an  unwilling  stepchild  of  computer  hardware  technical  advances.  Thus,  just 
when  software  analysts  and  programers  begin  to  feel  comfortable  with  a 
technical  level  of  computer  hardware,  a new  level  comes  along  and  their 
methods  become  obsolete.  Software  technology  is  also  growing  both  from  a 
managerial  and  a technical  standpoint.  For  example,  at  the  same  time  the 
analyst  or  programer  is  learning  to  deal  with  the  latest  in  data  base 
management  or  file  structuring,  he  is  hit  with  a new  technique  for  managing 
software  development  ic.g.,  structured  programing). 

1)  A ttiird  significant  factor  comjil  i eating  software  cost  estimatinq  is 
the  elusiveness  of  productivity  itself.  "Programing  productivity  has  been 
shown  to  vary  by  as  much  as  a factor  of  26  between  individuals"  1_/ 

4)  The  fourth  factor  affecting  software  cost  estimating  is  equally  as 
significant  as  the  first  throe.  However,  it  differs  in  one  important  aspect 
Whereas  the  first  three  arc  probably  unavoidable  in  a rapidly  growing  field, 
the  fourth,  the  lack  of  software  engineering  data  base,  does  not  necessarily 


*This  paper  was  based  upon  an  actual  system.  Although  specific  numbers  were 
changed  to  prevent  disclosure  of  the  system,  ratios  between  the  numbers  were 
retained,  thus  retaining  the  relationships  between  cost  estimates  and  actual 
costs . 

1/Poehm,  Barry  W.,  Datamation,  Ma\  1973:  "Software  and  Its  Impact; 

A Quant  it.it  ive  A.ssessment . " 
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have  to  bo.  Cortaitily,  oiiomjli  systj'ins,  largo  and  small,  h>»vo  bt'on  dovelopod 
in  nuiny  disoiplinos  to  havo  aoi-iuired  a ratlior  oxtonsivo  sot  of  cost  ostima- 
tiiKj  rolat  ionships  and  standards  wliicli  could  bo  used  in  ostimatinq  future 
software  costs.  However,  recording  of  this  i ntormat  iim  lias  boon  .sparce, 
and  as  a result,  a good  engineering  data  base  still  dot's  not  exist. 

In  view  of  the  above  complications,  a cost  estimate  for  software  develop- 
ment generally  reciuires  some  comliination  of  technigues  including  the  following: 

1)  Specific  Analogy.  Instances  in  which  costs  of  software  components 
can  be  relatt'd  to  softwart'  dt'velopmt'iit  cost  of  similar  components.  Because 
of  the  lack  of  a software  engineering  data  base,  the  n.'^e  of  this  technique 
may  be  siijnif icant  ly  limited. 

2)  Unit  Price.  Instances  in  which  the  number  of  units  and  their  per 
unit  costs  can  be  determined  (e.g.,  lines  of  code  and  cost  per  lint'  of  code). 

3)  Percent  of  Other  Item.  This  technique  m.iy  be  useil  when  the  cost  of 
some  portion  of  the  software  development  I'r  maintenance  can  be  estimated  as 
a predetermined  percentage  of  the  cost  of  another  item  (e.g.,  the  cost  of 
computer  program  design,  code,  or  test  might  be  some  relatively  pri'dictable 
percentage  of  total  software  development  i-ost). 

•1)  Parametric  Kquations.  Instanci's  in  which  the  costs  of  ['ortions  of 
the  software  development  can  be  estimated  from  an  equation  based  upon  various 
character  istics  or  rt'iiui  renu-nt  s . 

MPTHOlXihOi'.Y 

Based  upon  the  alxave  estimating  techniques,  a methodology  was  es t .ibl  i slu'd 
for  estimating  software  costs.  The  ('stim.ite  for  the  software  is  predicated 
upon  there  being  basically  nine  phasi's  of  softwan'  deve lopmf'nt  : Systems 
Requirements  Analysis;  Systems  Design;  Program  IXisign;  Coiling;  Progiam  Test ; 
System  Test;  User  Training;  System  Implementation;  and  Systems  Na i nt en.ince . 
Those  costs  incurred  during  the  first  eight  ph.Tse::  are  considered  software 
development  costs  for  purposes  of  this  analy;:is.  Sy:;tems  maintenance,  on 
tlie  other  hand,  is  considered  sufficiently  different  to  be  considered 
separately.  The  following  discussion  is  limited  to  software  development. 

Tlie  f'rimary  step  in  estimating  the  cost  of  softw.ire  development  was  to 
review  the  literature  for  methodology,  .iv’ailable  soltwari'  engiiu'ering  d.it.i 
bases,  cost  estimating  relationships  .ind  standards.  As  mentioned  pt ev i on:;  1 \ , 
there  is  a lack  of  appropriate  software  engineering  data  bases  av.iilable. 
Accordingly,  valid  cost  estimating  relationships  and  st.indards,  at  lower 
levels  of  detail,  are  scarce.  However,  at  a more  general  level,  the 
literature  is  somewhat  more  generous,  p.ii  t i cu  1 ai  I y with  rt'gatd  to  the 
relationship  between  the  various  maior  .'loftware  development  I iinct  ion;; . 

Partial  results  of  this  reseiirch  are  presented  in  Table  1. 
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SOFTWARE  COST  FACTORS 
COST  FACTORS/EQUATION 


SOURCE 


activities/%  OF  TOTAL  PROJECT^ 


1.  E.  A.  Nelson,  "Management  Handbook  Analysis  (.  Design,  34.5% 

for  the  Estimation  of  Computer  Programmer  Program  Coding  i.  Checking,  18. U% 

Costs",  20  Mar  67  (based  on  169  completed  Checkout  i.  Test,  47.5% 

computer  programing  projects) . 


2.  F.  P.  Brooks,  Jr.,  "Why  is  the  Soft-  Planning,  33-1/3% 
ware  Late?,"  Datamation,  Aug  71  (former  Coding,  If'- 2/3% 

Project  Manager  for  IBM  360  development  Component  Test  & Early  System 

has  applied  these  percentages  effectively).  Test,  25.0% 


3.  R,  A.  Findley,  "Computer  Software 
Development  Costs,  Predictable  or  Not? 
(Study  Report  Per  74-1) (Higher  Order 
Languages) . 

4.  R.  W.  Wolverton,  IEEE  Transactions 
on  Computers,  VOL  C-23,  No.  6,  Jun  74, 
"The  Cost  of  Developing  Large-Scale 
Software. " 

a.  Case  History  A. 


b.  Case  History  B. 


c.  "Rule  of  Thumb"  discovered  by 
several  researchers. 


SYSTEM 

ANALYSIS 

6 DESIGN 

SAGE 

39.0% 

NTDS 

30.0% 

GEMINI 

36.0% 

SATURN  V 

32.0% 

OS/360 

33.0% 

TRW  SURVEY 

46.0% 

System  Test  all  Components  in 
Hand,  .15.0% 

Analysis  t.  Design,  40.0% 
Coding,  15.0% 

Testing,  45.0% 


Software  Requirements  Analysis 
4.  Preliminary  Design,  29.8% 
Detailed  Design,  16.4% 

Code  and  Debug,  20.0% 
Validation  Tost  & Operational 
Demonstration,  13.5% 
Development  Test,  20.3% 
Analysis  t;.  Design,  42.0% 

Code  s Debug,  33.0% 

QA  Test  & System  Tests,  25.0% 
Analysis  Di-sign,  40.0% 

Coding  Debugging,  20.0% 
Checkout  S,  Test,  40.0% 


CODING  S, 

CHECKOUT 

AUDITING 

& TEST 

14.0% 

47.0% 

20.0% 

50.0% 

17.0% 

47. 0% 

24.0% 

44.0% 

17.0% 

50.0% 

20.0% 

34.0% 

TABLE  1 
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>lodified  Dolphi  Techiiitj^iie . The  Deli)hi  technique  was  used  because, 
althouqh  the  problem  did  not  lend  itself  to  precise  analytical  techniques, 
the  subjective  judqments  of  o qroup  of  experienced  personnel  could  be 
obtained  for  evaluation. 

I)  A qroup  of  experienced  senior  software  manaqers  was  assembled  and 
qiven  a presentation  and  qeneral  specifications  for  a larqe  automated 
telecommunications  system  (hereafter  referred  to  as  System  X),  includinq 
itiformation  on  difficulty  and  complexity. 

J)  The  qeneral  approach  used  to  obtain  contributions  from  the  qroup 
on  each  item  was: 

a)  The  monitor  made  a presentation  describinq  the  problem  and  what 
was  desired  as  a contribution. 

b)  The  qroup  was  encouraqed  to  ask  questions  and  discuss  the  problem 
until  each  had  a qood  understandinq  of  the  problem  and  the  required  con- 
tribution. 

c)  Each  member  then  prepared  an  independent  contribution  and  identified 
the  principal  factors  considered  and  their  impact  on  the  problem. 

d)  The  monitor  analyzed  the  contributions  from  the  qroup  and  prepared 
a candidate  description  of  the  data. 

e)  The  monitor  then  made  point  checks  where  possible,  and  further 
reviewed  the  candidate  data. 

J)  The  problems  presented  to  the  qroup  for  consideration  are  identified 
below: 

a)  Allocate  the  software  effort  to  eiqht  basic  functional  tasks. 

b)  Discuss  and  identify  each  party's  problem  in  consuinatinq  all  tasks. 

c)  Defend/support  decisions  with  verbal  arquments. 

The  information  provided  throuqh  the  alxive  process  was  analyzed  and 
further  evaluated  to  provide  the  basis  for  the  distribution  of  effort. 

After  the  data  were  orqanized,  several  spot  checks  were  made  to  validate 
data  points. 

Based  on  the  results  of  the  above  process,  the  objective  of  estimatinq 
software  development  costs  was  pursued  in  two  phases.  The  first  phase 
consisted  of  runninq  a Software  Cost  Estimate  (SCE)  model  to  develop  an 
independent  parametric  estimate;  and  the  second  phase  consisted  of  applyinq 
risk  analysis  via  the  use  of  a Risk  Analysis  model  to  the  results  of  the 
first  phase.  The  SCE  model  accepts  as  input  several  factors  developed  in 
the  modified  delphi  technique  or  obtained  from  technical  docuimuits  and 
reports.  From  this  input,  the  model  derives  the  expended  funds,  cost  to 
complete,  and  total  cost  at  com^iletion  for  the  software  proqram.  Major 
inputs  to  the  model  are: 
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1)  Percentage  of  software  module  development  allocated  to  the  various 
software  development  activities. 

2)  Complexity  element.  The  primary  indicator  of  complexity  for  Syst  'm 
X was  determined  to  be  the  size  of  the  program  module  (number  of  instruc- 
tions at  completion) . Thus,  it  was  necessary  to  identify  the  principal 
software  modules  for  a specified  level  of  detail  and  estimate  the  number 
instructions  required  to  perform  each  tas)c  of  the  specified  software  mo<.u.  s 

3)  Percentage  Completion. 

The  major  output  of  the  SCE  model  is  an  estimate  of  software  develop- 
ment (including  documentation)  costs.  However,  due  to  the  nebulous  nature 
of  software  development  in  complex  systems,  it  became  apparent  that  a ris)t 
analysis  model  would  be  needed  to  enhance  the  credibility  of  the  cost 
estimate.  This  model  was  used  to  characterize  the  high-risk  elements 
associated  with  System  X.  The  model  basically  estimated  a mean  risk  factor, 
i'-s  standard  deviation,  and  the  range  of  risk  factors  considering  the 
principal  high-risk  elements  of  System  X software. 

The  approach  taken  for  the  risk  analysis  was  to  identify  the  principal 
risk  elements  and  to  estimate  for  each  the  associated  distribution  of 
the  factor  increase  in  final  cost.  The  assembly  of  these  high-risk  elements 
and  their  associated  increase  cost  factor  distribution  is  called  the  raw 
risk  factor  matrix  (see  Tables  2 and  3 for  subsystems  A and  B respectively) . 

The  13  risk  areas  (program  growth,  core  growth,  etc.)  were  selected  as 
those  which  could  conceivably  result  in  cost  growth  in  the  software  develop- 
ment. The  identified  high-risk  factor  elements  are  characteristic  of  soft- 
ware programs  in  general.  The  raw  risk  factor  matrix  was  developed  con- 
sidering other  software  programs  with  special  attention  to  System  X.  The 
20  factors  across  each  row  reflect  an  assessment  based  on  experience  with 
'similar  systems  as  to  the  magnitude  and  likelihood  of  this  cost  growth. 

For  example,  for  Subsystem  A,  Table  2 indicates  that  in  seven  out  of  20 
occurrences,  (35%  of  the  time),  "progrcim  growth"  could  be  expected  to 
increase  the  cost  of  software  development  by  at  least  40  percent.  In  two 
out  of  20  times  (10%),  it  would  increase  it  by  30  percent,  etc.  Multiply- 
ing the  risk  factors  for  any  given  column  will  give  the  final  risk  factor 
for  the  described  conditions. 

An  analysis  of  the  Subsystem  A software  program  for  the  specified  risk 
factors  shows  the  expected  average  increase  in  cost  for  a program  of  the 
complexity  of  System  X is  241  percent  of  the  principal  cost.  An  analysis 
of  the  subsystem  B software  program  for  the  specified  risk  factors  shows 
the  expected  average  increase  in  cost  for  a program  of  the  complexity  of 
System  X is  199  percent  of  the  principal  cost. 

Once  the  basic  cost  estimate  was  developed  for  System  X subsystems, 
and  the  risk  factors  derived,  the  following  equation  was  used  to  develop 
a final  cost  estimate. 

Principal  Cost  x Risk  Factor  = Final  Cost 
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SUBSYSTEM  A RAW  RISK  FACTORS 


RKi-'.RESSION  ANALYSIS 


This  approach  consists  of  the  development  of  a trend  line  on  the  basis 
of  previously  estimated  contract  prices  and  projection  of  this  trend  to 
future  costs.  The  following  data  were  obtained  from  Cost  Performance 
Reports  prepared  by  the  System  X contractor. 

ESTIMATl^D  SOKTOARE  COSTS  ($  MILLION) 


AS  OF  DATE 

SUBSYSTEM 

A 

SUBSYSTEM 

B 

TOTAL 

31  .t.iy  74 

1 . 025 

.893 

1.918 

31  IX'c  74 

1.150 

1.07  3 

2.224 

31  Jul  75 

1.  36.1 

1.124 

2.487 

31  Dec  75 

1.378 

1.447 

2.825 

31  IX'C  76 

2.730 

3.936 

6 . 656 

31  Dec  76 

2 . 689 

4.742 

7.432 

31  vT.in  77 

2.690 

4.742 

7.432 

As  of  11  May  1974,  the  contractor's  estimated  software  development  cost 
was  1.919  million.  These  estimates  have  progressively  increased  over  the 
last  J 1/1  years  to  t lie  most  recent  estimate  of  7.412  million. 

The  assumption  behind  the  trend  line  approach  is  that  a discernible 
trend  of  escalating  costs  has  already  been  established,  which  is  an  histor- 
ical composite  of  estimating  error,  contract  redefinition,  mismanagement 
.ind  rewark.  It  is,  in  effect,  a summarization  of  the  technical  and  human 
elemt'nts  at  work  on  this  project,  both  anticipated  (the  initial  1.918 
million),  and  unanticipated  (the  additional  5.514  million),  to  date.  It 
further  assumes  that  the  same  elements  will  continue  to  impact  on  this 
project  until  its  conviction.  Thus,  if  the  assumption  holds,  the  extension 
of  the  trend  line  using  regression  analysis  techniques  should  provide  a 
reasonable  estimate  v"*!  the  final  cost. 

The  method  selected  for  fitting  the  curves  is  the  Stepwise  Multiple 
Lineir  Regression  (least  squares).  The  correlation  coefficients  for  Sub- 
system A and  .Subsystem  B were  .92  and  .91,  respectively.  These  correlation 
coefficients  .are  significant  at  the  95  percent  confidence  level  indicating 
that  .1  probable  cause  and  effect  relationship  exists  between  the  time  of 
the  estimate  and  estinvited  costs  to  complete  the  software.  Analysis  showed 
a significant  linear  regression  was  present  and  that  the  slope  is  signifi- 
cantly different  from  zero. 

Based  on  the  .ilxDve  projections  of  softw.ire  development  costs  for  current 
elap’sed  time  estimates  of  2B.1  nxinths  (Subsystem  A)  and  .11.9  months  (Sub- 
system B)  are  $3,536  million  and  $7,267  million  respectively  for  a total 
of  $10,801  million. 
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Thi;.  aJJi  t 1 v<'  wliK'h  will  Ih'  vMlUvi  tin-  "['CittV't  vi;.ion"  i 

l ;.tK'Wii  In' low  : 


Aliy  point  on  thin  ounvo  rofloots  Oviii.i  1 i t >■  bi'twoon  ont  im.it  oh  t imo  to 
oomploto  .1  pioioot  .inh  .lotu.il  t imo  roquiri'.i  to  v-omploto  t ho  job.  I'oi 
ox.implo.  It  ono  tiilU'wn  .i  voitu-.il  lino  t i om  t ho  point  slu'wrn  to  t ho  lu'r  i rout  1 
.i.xin,  .ukI  t hon  tollowi;  .i  hoii.:ont.il  1 1 lU'  to  t ho  voitio.il  .ixis,  it  In'iximos 
.ipp.nont  th.it  t ho  »'ntim.ito  ot  JO  iiKMittin  ov',u.ils  t ho  .lotu.il  ol.ipnoh  t iiiio  ol 
JO  iTKintlu:.  Thus,  t ho  toim  "poitoot  vinion"  lino.  With  poi  toot  visiiui,  .in 
inhivi.iu.il  wouKi  initi.illy  ostim.ito  JO  months  to  oomploto  t ho  lob.  Any 
fuitlior  o'-tim.ito  woulh  .ilso  In'  JO  months.  A i outossion  lino  ttuouuh  tht'so 
points  would  obviously  bo  .i  hv'v  i .•'Mit  .i  1 lino  .it  iix'nths.  This  lino,  .ilonu 
with  t ho  "portoot  vision”  lino  is  slw'wu  bolow. 


As  stii'wn  .iK'vo,  .It  till'  point  ot  intorsootion  (JO  nv'nths),  t ho  lob  is 
oiimploto  .IS  w.is  ostim.itod.  Now  .issumo  th.it  t ho  ost  im.it  oi'  doos  not  h.ivo 
porfoct  vision,  but  tor  v.irioiis  lo.isons,  undor-oiit  im.it  os  tho  t imo  loquirod 
to  oomploto  tho  job  .ind  th.it  tho  dovolopor  ot  t hoso  outvos  is  .iw.iro  of 
this.  Th.  d lolopor  m.iy  know  this  oithoi  by  histoi  io.il  obsorv.it  ion  of  tho 


estimator,  or  as  in  the  case  of  System  X,  by  actually  observing  several 
progressively  increasing  estimates.  In  either  case,  the  developer  can  use 
this  knowledge  to  predict  the  point  of  completion  of  the  job  just  as  he 
could  use  the  knowledge  that  the  estimator  has  perfect  vision.  The  method 
for  utilizing  this  knowledge  is  basically  to  adjust  the  slope  of  the 
horizontal  line  running  from  the  estimator's  estimates  to  the  "perfect 
vision"  line.  This  is  accomplished  through  the  regression  technique  for 
this  analysis.  In  the  following  graphs,  the  adjusted  estimator  lines  and 
"perfect  vision"  lines  are  coupled  to  provide  a best  estimate  of  the  actual 
elav'sed  time  to  com^'lete  the  Sulisystem  A and  Subsystem  b software. 


In  order  to  develop  an  estimated  cost  for  software  development,  it  is 
now  necessary  to  apply  the  regression  formulas  derived  from  the  previous 
cost  regression  analysis  to  the  time  estimate  of  35  months  (Subsy.stem  A) 
.ind  53  months  (Subsystt'm  B)  shown  above.  The  results  of  this  are  sliown 
below: 


SUBSYSTEM  A 

SUBSYSTEM  B 

TOTAL 

A .22  Mill ion 

12.01  Million 

16.23  Million 

It  should  be  noted  at  this  point  that  the  projected  time  estimates  of 
35  months  and  53  months  for  Subsystem  A and  Subsystem  B respectively  are 
not  intended  to  be  used  as  a projection  of  actual  completion  times  for 
System  X software  development.  Rather,  these  are  simply  projective  of  the 
time  which  would  be  required  per  the  current  trend  for  use  in  the  cost 
regression.  Obvious  by  its  absence  is  the  management  alternative  of  pro- 
viding an  additional  resource  at  some  point  to  reduce  the  elapsed  time. 
However,  this  is  seen  as  a separate  problem  which  might  either  increase  or 
decrease  the  above  cost  estimate.  It  is  not  considered  worthwhile  to  pro- 
ject this  potentiality  at  this  point  as  it  would  require  second  guessing 
management  reaction  to  events  which  have  not  occurred. 
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The  software  experts  who  conducted  the  previously  described  Modified 
Delphi  Technique,  were  asked  to  assess  risk  factors  for  the  current  System 
X contract  specifically  with  reqard  to  software  from  the  Modified  Delphi 
Technique,  their  two  independent  assessments  resulted  in  the  followinq 
estimates : 

SlIBSYSTKM  A SUBSYSTEM  B TOTAL 

Kxpert  #1  $4,924  M $10.44)  M $15,367  M 

Expert  »2  $5,936  $12,266  $18,201 

The  validity  of  each  expert's  opinion  was  judged  to  be  equal,  therefore, 
a simple  average  of  the  two  is  considered  an  adequate  comjosite.  This  re- 
sults in  an  estimated  total  cost  of  $lt>.  /84  M.  This  estimate  is  surprisingly 
close  to  the  $16,233  M derived  via  the  regression  technique.  In  either  case, 
the  estimated  total  cost  is  over  eight  times  the  original  contractor  estimate 
of  $1,918  m; 


Rf;COMMi:NDATIONS 

The  lessons  learned  during  this  study  suggest  a set  of  goals  which  should 
be  extremely  valuable  to  any  government  agency  requiring  software  development. 
In  fact,  the  degree  of  success  achieved  should  be  directly  pioportional  to 
the  nearness  with  which  reality  compares  to  the  set  of  goals.  These  goals 
are  presented  as  a list  of  recommendations  below. 

1)  Emphasize  Front- End  Planning,  Analysis  and  L~)esign.  Mucii  of  the  cost 
growth  in  software  development  is  a natural  outgrowth  of  ill-defiuod  systems 
and  resulting  attempts  tc  plan,  design,  and  develop  systems  simultaneously. 
Plan  on  35-45  percent  of  the  software  develoj'ment  effort  occurring  before  a 
single  line  of  code  is  written! 

2)  Minimize  Modifications.  The  number  of  modi f ications  revjuired  will 
probably  be  reduced  significantly  by  adhering  to  the  first  recommendat ion . 
Tight  controls  should  be  exercised  on  renwining  modif icat ions . 

3)  Hold  Software  Developers  To  Their  Estimates.  By  adhering  to  the 
first  two  recommendations,  it  should  be  possible  to  present  the  software 
developer  with  a complete  set  of  plans  and  speci f icat ions  and  impose  severe 
penalties  for  significant  deviations  from  Llieir  initial  cost  estimates. 

4)  Develop  an  In-House  Software  Cost  Estimating  Cap.ilulity.  IV)  not 
entrust  this  important  function  to  software  developers  whose  ludgment  may 
be  tainted  by  the  fact  that  they  are  competing  for  the  award  of  a contract. 

5 ) Develop  Cost  Estimating  Relationships  ICFH's)  and  Standards . 
Communicate  experiences  in  software  development  so  thit  2FK':  at.d  .st  andat  .1;- 
may  be  developed  for  use  in  future  t'f  forts. 

5'JM.MARV 

It  is  imperative  that  tlie  validity  of  software  cost  e iimites  bt'  improved. 
The  experiences  and  resultant  recommendations  gei.etated  by  t ■■  lej  u t w i 1 
facilitate  the  accomplishment  of  this  imoroxemi’nt  . 
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TITLE:  "RISK  ANALYSIS  AND  COMMUNICATIONS  COSTING:  A PRACTICAL  APPLICATION" 
AUTHOR:  Mr.  John  Bezner 


ABSTRACT : This  paper  outlines  the  risk  analysis  techniques  used  to  aid  in 

developing  a cost  estimate  for  a large  scale  communications  system.  Included 
is  a discussion  of  the  methods  used  to  quantify  the  uncertainty  associated 
with  both  schedule  and  technical  aspects  of  the  project.  The  methods  used 
include  Advanced  Solvnet,  Delphi,  a specially  tailored  monte  carlo  simulation 
and  subjective  judgment.  Special  emphasis  is  placed  on  discussion  of  data 
collection,  analysis  and  interpretation  of  results  of  the  schedule  risk  analysis. 
The  risk  quantifications  are  related  to  cost  factors  to  provide  a measure  of 
risk  in  dollars.  The  results  of  the  dollar  quantification  are  then  in  a form 
useful  for  sensitivity  analysis  and  determination  of  a management  reserve. 
Finally,  comments  concerning  the  apparent  worth  of  the  information  obtained 
are  provided. 
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RISK  ANALYSIS  AND  l Y )MMnN  I CAT  I ONS  CO.STnwC: 
A I lcACTICAL  Al’PI.ICATION" 

M)  . Jolni  S . Hi’i’.tu't 

U..S.  Armv  ('innimin  i I'.i  t i on:,  ('oininautl 


l.v'  TRI’.KAiT;  . 'nil.'  lii’Vc  1 Di 'im'ii  t (Jl  .1  lictaiU'ii  <o:.t  iv.t  im.il  i’  foi  ,i  l.itijc 

HcaU'  ixinumin  1 1 M t u)t':5  systi'ni  i .s  an  I’xac  tiiui  tank.  Tlu’  numbct  aiui  variaty 

of  I'omjKJru'Mt  nu-mtu'i  s of  suoh  a systoro  yrovviU'  imoi «'  I h.ui  amplo  oj  i|  k u t tin  i I y 
for  errors  of  iliipl  ic.it  loti  oi  omissiiin  Ka  oconi  I li  .niil  1 1 i oti , the  (Jala 
source;;,  inflatuin  tactoi;;,  (.-ost  e:;  I i m.i  1 1 luj  re  1 .i  t i onshi  ps  , learning  (,'iiivi' 
slope;;,  co.st  f.ictor;;  .m.J  expeit  pifJpmi’nt  .ill  coiit  t i luit  <'  tii  the  Ciiinpl  I'Xi  t y 
of  .i  lin.il  i;i>;,t  t i m.it  1' . Tlie  acciir.icy  of  these  i ndiviiin.il  input. s provide 
the  boundarie.s  of  .icour.icy  for  the  tot.il.  Sui  rounci  i luj  .ill  of  these  l.i.-tors 
IS  somi'thiim  .-.ilted  ri;;k,  1 1n-  qu.int  i f i.ib  1 e uncert.iinty  .is.soci.ited  with  the 
future  of  the  proie.-t.  The  purpose  of  thi.s  paper  is  to  demons  fi  .it  e the 
import.in.re  of  a risk  an.ilysis  in  the  di'Velopment  of  .i  tot.il  cost  t'st  im.it  e . 

Tile  b.isis  for  this  demons  t r.it  ion  is  .in  actu.il  .ippl  i .m  t ion  ol  the  t I'chn  iipie:! 

de.scribed. 

1.1  INTROppC^riON.  Purinq  thi'  sprinq  of  ld77,  a t e.im  iif  .in.ilysls  .ieveloped 
.in  tndiq'endent  r.irami'tric  Cost  K.stimate  (IIVK)  foi  .i  L.iiq.'  .Sc.ile  Comiminir.i- 
tions  Systi'm*.  In  ordt'r  to  devt'lop  the  cost  estim.ite,  b.isi.'  .isiiumpt  ii.'ns 
concernin.i  .i  pro.ir.im  schedule  an.!  system  conf  iqur.if  i on  wen*  la'quired.  These 
.issumpt  i on:;  maiJe  it  possible  to  orqani /.e  and  structure  the  cost  an.ilysis 
procedure.  However,  .i  serious  cost  estim.ite  th.it  doi's  not  include  ri'.ilistic 
research  into  the  effect  of  those  basic  assumptions  is  considered  to  lai'k 

.ill  import. int  inqrodient  of  credibility.  Therefore,  .i  risk  .in.ily:;is  which 
addresses  tliose  questions  of  concern  to  the  irCE  btu.iy  Tivim  w.is  conducted. 
The  obiectivo  of  this  risk  analysis  w.is  to  support  the  costiiM  effort  .is 
opposed  to  suppl.intinq  the  norm.il  cliist'  [ii'o  jt'i-t  ;;crutiny  expect  I'd  of  a 
formal  Di'cision  Risk  An.ilysis. 

1.2  MIlTHOnOLt^Y  . This  analysis  is  dividi'd  into  two  ph.ises  ; .pi.uit  i f i cat  ion 
of  uncert.iinty  .ind  .ippl  ic.it  ion  of  this  . pi. mt  i f ic.it  ion  to  the  costiiui  I'ffort. 
Within  the  fiist  jiluise,  theie  exists  .i  further  subdivision,  scheoule  and 
technical  risk  are  each  qiven  sopar.ite  attention.  Tliouqh  techniques  v.iry 
.ind  the  level  of  accuracy  achievable  is  not  i:onstant,  the  central  t hemi' 

is  m.iintained  throuqhoul  the  an.ilysis.  That  theme  is  to  .irrivi'  .it  som<' 
me.isurable  determination  of  risk  which  will  permit  intelliqent  discussion 
of  the  impact  on  the  cost  of  the  project.  Koi-  the  purposes  of  this  p.iper, 
one  p.irt  of  the  risk  quanti  f icat  ion  (schedule)  will  be  .iddressi'd  in  detail, 
the  other  part  (technical)  will  be  covered  only  to  tin'  extent  required  to 
expl.iin  fitiase  II  (appl  ic.ition  to  costinq)  . 


*Vho  name  of  the  system- is  withheld  .ind  the  study  results  h.ive  bci'ii 
(jencr.ilized  in  order  to  present  the  techniques  without  divulqinq 
privileqej  inform.ition. 


a.  Schedule  Risk  An^ly^is . Tlie  risk  analysis  procedure  employed  to 
examine  the  project  scliedule  consists  of  seven  parts.  These  parts,  along 
with  the  or<)ani ^iational  elements  that  contributed  to  the  completion  of  each 
part,  are  summarized  in  Table  1.  Discussion  of  each  of  these  parts  is  pro- 
vided in  more  detail  in  the  paragraphs  following  Table  1. 


1 SCHEDULE  RISK  ANALYSIS  STRUCTURi:  ] 

TASK 

ORGANIZATIONAL  INPUT 

Subtask  Identification 

Independent  Communications  Group 
Project  Office 

IPCE  Study  Team 

Scliedule  Model  Development 

Independent  Communications  Group 
Project  Office 

IPCE  Study  Team 

Scliedule  Data 

Independent  Communications  Group 
Project  Office 

IPCE  Study  Team 

Probability  Data 

Independent  Communications  Group 
Project  Office 

Analysis  Proper 

IPCE  Study  Team 

Sensitivity  Analysis 

Independent  Communications  Grouji 
Project  Office 

IPCE  Study  Team 

Report 

IPCE  Study  Team 

TABLK  1 


(1)  Subtask  identi f ication  cons’sts  of  determining  the  set  of  discrete 
activities  which  are  required  for  completion  of  the  project.  This  set  of 
activities  was  chosen  subject  to  constraints  which  require  analytical 
manageability  and  a reasonably  accurate  rei^rc'sentat  ion  of  project  reality. 

(2)  Schedule  model  development  consists  of  identifying  the  proper 
interrelationship  of  the  nubtasks  in  terms  of  constraints  and  milestones. 

In  the  course  of  developing  network  models  of  the  project,  six  basic 
alternatives  were  identified.  (I'or  an  example,  see  Figure  1.)  These 
alternatives  include  variations  of  dependency  between  two  major  subsystems 
(As  B) , ideas  offered  by  both  data  sources  (the  Independent  Communi cat  ions 
Group  and  the  Project  Office),  and  varied  methods  of  tiandling  avlminist  rat  i ve 
matters  (contract  award,  ASARO/DSARC  decision  processes,  etc.). 


743 


ALTERNATIVES  #1  AND  #2 


CURE  1 (Figures  2-6  not  included) 


(3)  Schedule  data  was  collected  by  employing  a modification  of  the 
Delphi  teclmique.  b/  Representatives  from  both  of  the  data  source  groups 
participated  in  supplying  the  required  schedule  information.  In  addition, 
data  available  in  the  form  of  official  project  schedules  were  used  when 
applicable.  In  most  cases,  a consensus  was  reached  for  each  of  the  time 
estimates  for  every  project  subtask. 


(4)  Probability  data  required  for  this  analysis  was  limited.  For 
those  cases  in  which  a probabilistic  estimate  was  required,  a consensus 
of  expert  opinion  was  used. 


(5)  The  schedule  analysis  effort  was  conducted  by  employing  the 

Advanced  SOLVNET  Model.  Advanced  SOLVNET  is  a user-interactive  computer 
program  that  facilitates  the  analysis  of  systems  that  are  representable 
by  a general  class  of  network  structure.  The  model  allows  the  incorpora- 
tion of  a wide  range  of  logic  propositions  for  each  decision  point. 
Consideration  of  probabilistic  situations  is  included.  The  program  is 
written  in  FORTRAN  IV  and  is  operational  on  the  Army  Communication  Command's 
CDC  6500.  A complete  discussion  of  the  operation,  capabilities  and  limita- 
tions of  the  Advanced  SOLVNET  Model  is  available  in  the  SOLVNET  User's 
Manual.  A more  complete  discussion  of  Schedule  Risk  Analysis  techniques 

in  terms  of  background  and  application  is  available  in  the  Army's  Decision 
Risk  Analysis  Manual.  3/ 

(6)  The  sensitivity  analysis  for  the  schedule  portion  of  this  risk 
analysis  was  limited  to  one  variation  on  the  basic  input  data.  That 
variation  is  the  investigation  of  the  effect  of  lowering  the  optimistic 
estimate  for  all  individual  time  inputs  by  10  percent  of  the  basic  input. 

(7)  The  results  of  this  portion  of  the  risk  analysis  were  provided 
in  two  levels  of  detail:  First,  a set  of  major  observations  pertaining 
to  the  schedule  aspect  of  the  overall  project;  and  second,  a summary  of 
the  schedule  analysis  results. 


(a)  Observations. 


1 Based  on  the  analysis,  the  probability  of  achieving  the  scheduled 
IOC  date  and  other  milestones  was  provided. 

2 In  all  but  Alternative  #3,  the  subsystem  A path  wa.s  found  to  be 
longer  than  the  subsystem  B path. 

3 The  support  activities  related  to  the  parent  program  wer>  't 
constraining  the  program. 


l/"Systematic  Use  of  Expert  Opinions,"  Olaf  Helmer,  November  19>'7. 
2/Advanced  SOLVNET,  "A  Network  Analyzer  Program,"  Stephen  R.  Pearcy, 
Report  No.  PAPAS-14,  January  1973,  Revision  2,  February  1975.  Plans 
Office,  Picatinny  Arsenal. 

3/A  Course  of  Instruction  in  Decision  Risk  Analysis,  US  Army  Logistics 
Management  Center,  Fort  Lee,  Virginia,  1974. 


r 


i 

f 


745 


^ Basotl  on  tho  analysis,  t ho  projoct  soluiiulo  was  I’ons  i 
opt imistio . 

^ In  i-ultiition,  ,i  nuiuiit'i'  ot  tii't  ^i  i It'd  ('l>^;l’rv,lt  lorn;  t:onoornintj  Viii  iitin; 
statues  of  tlio  proioot  woro  provitit'd. 

(b)  Scliodulo  Summary.  Tho  rosultt;  of  tho  Sclu-dulo  Kisk  Analysis 
woro  providod  in  tiraph,  tablo  and  oomput.or  printout  form.  Mas.sivo  anuiunts 
of  dotail  aro  <jonoiatotl  in  such  an  analy.sis,  t lio  critical  rotiuiiomcnt  is 
to  offoctivoly  summaiizt'  tho  tiata.  Tablo  ~ is  an  t'x.imi'lo  ot  summariiioti 
data. 
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b.  'IT^chnu^il  Risk  Analysis.  Tho  risk  procoduro  used  to  oxarnino 
technical  risk  consists  of  two  patts;  software  and  hardware. 

(1)  Software  Risk  Analysis  Kt'sults,  Tho  nature  of  software  dt'volop- 
mont  is  one  which  inherently  involvi's  hiuli  risk.  Kvon  the  simplest  of 
proqr.ims  can  bo  plaquod  by  ftilst>  starts,  proutam  qrowtli,  system  i ntoqr.it  ion, 
timinq  analysis  problems,  t'tc.  In  f.ii't  , t tu'  t-omploxity  of  .in.ilyr.inq  soft- 
w.ire  development  is  sufficient  to  h.ive  tjener.itotl  a speci.il  p.iper  devoti'd 
entirely  to  this  subject.  d/  I’or  this  re.ison,  det.iils  of  the  software  risk 
analysis  are  not  V'n->vided  here.  however,  it  is  (•■eitinent  to  mention  th.it 


4/"A  Software  Cost  Rstiimit  inq  Technique  for  t’ommun ic.it  ions  Systems," 
Stan  Dunn,  M.iy  1^77. 
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till'  rt’sii  1 1 vjiit  pioiiuct  is  a set  at  risk  factors  to  apply  a^aitist  basic  cost 
estimates.  These  risk  factors  .plant  ify  the  micerta  i lit  y associated  with 
the  siiftware  di-velopmeiit  problems  mentioned  above. 

(J)  Hardware  Kisk  Analysis  Results. 

(a)  Risks  in  the  hardware  seqment  not  related  to  software  problems 
or  schedule  problems  were  considered  small.  Howevi'r,  to  insure  no  items 
of  ^Kitential  risk  were  overlooked  in  the  hardware  seqment  of  the  project, 
an  analysis  system  based  on  expert  opinion  was  developed.  This  system 
included  a review  of  project  status  aiul  a delphi-like  assessment  by  an 
independent  set  ot  experts.  Amonq  the  areas  of  hardware  risk  investigated 
using  this  technique  are: 

Rnqi nee ring, 
rercent  Completion, 

Modi f icat ions. 

Space,  Weight  and  Power, 

Hardware/Software  Integrat ion. 

Lea  r n i ng  Kxper i ence , 

Power  Processor,  and 

Mix  of  Space  Division  Multiplexers  and  Time  Division  Multiplexers. 

(b)  Prom  this  examination,  hardware  risk  areas  identified  include 
the  need  for  expanded  capacity,  apparent  excessive  modifications,  and 
unceitainty  associated  with  the  learning  iiurve  slope. 

1 . ,i  RKSDl.TS,  WHAT  NE.'W?  At  this  point,  a set  of  risk  results  ranging  from 
numerical  probabilities  to  qualitative  remarks  was  available  for  schedule 
and  technical  factors.  The  next  key  task  was  the  conversion  of  risk  data 
into  an  assessment  of  its  impact  u^xin  cost . 

1.4  l^PldCAHON  COSTINC.  The  results  of  the  risk  analysis  were  used 
in  the  IPCE  in  five  major  ways. 

*As  a factor  to  apply  to  basic  cost  estimates. 

*As  a quantification  of  costs  expected  to  occur  outside 
the  then  current  scope  of  the  project. 

*As  a method  of  determining  valid  ranges  for  the 
sensitivity  analysis. 

*As  a method  of  determining  an  adequate  management 
reserve  for  the  project. 

*As  a means  of  identifying  and  highlighting  iminagement 
issues . 
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Amplifying  discussions  and  exanples  for  each  of  the  five  uses  are  provided 
in  the  following  paragraphs. 


a.  Risk  Factor.  In  many  instances,  it  was  possible  to  identify  a 
factor  to  apply  to  cost  estimates  developed  for  "all's  well"  situations. 
This  process  is  especially  applicable  to  labor  intensive  activities  in- 
volved in  the  development'  of  highly  complex  outputs. 

EXAMPLE;  Software  Development 

Total  Cost  = Basic  Cost  Estimate  x Risk  Factor 

NOTE:  For  this  application,  the  risk  factor  was  developed 

by  taking  the  mean  value  from  a distribution  developed 
through  Monte  Carlo  simulation  (2,000  iterations  with  13 
variables) . 

b.  Outside  Scope.  This  category  consists  of  costs  for  items  of 
equipment  or  work  efforts  not  fully  recognized  at  the  time  of  tlie  cost 
exercise. 

EXAMPLE:  In  one  instance,  the  investigation  revealed  that, 

though  not  planned  for,  an  additional  component  would  be 
required  for  effective  operation  of  the  system.  This  com- 
ponent involved  expanding  capacity  of  existing  equipment  and 
the  entire  cost  of  the  new  element  was  added  to  the  total 
system  cost. 

c.  Sensitivity  Ranges.  Typically,  the  ranges  employed  in  a sensi- 
tivity analysis  degrade  to  an  arbitrary  ± X%.  In  most  cases,  this  results 
from  the  absence  of  any  better  way  of  assigning  end  points.  Contrast  this 
to  the  process  used  for  this  study  in  which  the  risk  analysis  results  were 
used  to  examine  each  critical  variable  to  determine  the  most  reasonable 
range. 


EXAMPLE:  Consider  the  schedule  question.  What  variation 

from  the  planned  schedule  is  meaningful  and  how  is  this  time 
variation  converted  to  cost? 

After  careful  evaluation  of  the  six  schedule  alternatives. 
Alternatives  #1  and  #5  were  selected  as  the  most  realistic 
and  appropriate  for  this  analysis.  Alternative  #1  represents 
the  Independent  Communications  Group's  more  optimistic  input 
(still  pessimistic  compared  to  the  Proiect  Office's  input). 
Alternative  #5  was  selected  as  the  most  acceptable  input  from 
the  Project  Office.  These  two  inputs  were  selected  based  on 
their  merits  (e.g.,  project  knowledge,  bias,  effort  expended, 
understanding  of  the  SOLVNET  technique,  etc.). 
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Tlu'ii,  for  of  oslabl  ishiiig  a ranqe  of  values  for 

schoiluU'  slipf'aijo,  the  quickest  date  expiMieucod  for 
Alteruative  tS  was  selected  as  t lie  earliest  possible 
ci'wpletioii  date,  and  the  latest  date  experienced  for 
Alternative  #1  was  solecttxl  as  the  latest  [Possible  com- 
pletion daft'  (see  I'iquro  2). 

Now,  qiven  the  maximum  re,»son.Uile  end  points  of  schedule 
ranq»',  these  I’lul  points  were  compared  tii  the  I'xpec'ti'd 
c<implct  ion  dates  within  the  K.s.b  Phase  and  the  Invi'stment 
Phase  of  the  pro  i»>ct  . 

Finally,  a I'ost  factcir  p<'r  iikuith  for  sclu'dule  r lipjaqc 
was  determined  by  cost  phase  and  api'lit'tl  aqainst  the 
number  of  months  of  expected  variance  from  the  official 
schedu  1 (' . 

d.  Management  Keserve.  After  a set  of  sensitivity  raiKn-s  havi'  been 
developed  ti’  denK'nst  rate  tlu'  poti'iitial  effect  of  the  unknown,  a critical 
question  must  be  asked.  How  much  <.if  what  can  gi'  wrong  will  go  wnnig? 

Mine  directly,  wh.it  portion  of  possible  ci'st  increase  should  be  set  .iside 
as  manageim'iit  H'seive  to  .ivoid  critical  funding  problems?  The  results  of 

I,  a risk  .in.ilysis  go  a long  w.iy  towards  helping  to  answer  this  question. 

H'  V^uant  i f icat  u’n  of  uncert.iinty  m.ikes  it  possible  foi  dec  i s ionmakers  to 

" supplt'ment  subiective  iiuigment  in  a positive  manner. 

FXAMPI.F:  I’onsider  .ig.iin  Figuii'  J.  For  det  ermi  nat  ion  of 

man.mement  teservi'  tor  scht'iiuU',  t ht'  .irithmetic  .iverage 
ot  the  im'des  ot  Alternative  Hi  and  wa:;  recommended. 

That  IS,  the  luiml't'i  of  months  diffcience  in  the  averaged 
Hk' te.s  of  »1  and  ns  .ind  t hi'  scheduled  UX'  was  multiplied 
by  the  .ippi opi  i.it e cost  per  iikMitli  factor  to  art  ive  .it  a 
man.i  lement  leserve  for  si-hedule. 

e.  M.in.igement  Issues.  In  m.iny  c.ises  , it  w.is  possible  due  to  t he 
risk  ex.imi n.it  ion  process  to  point  out  to  m.in.igement  various  potent  i.il 
problems  th.it  given  immedi.ite  attention,  would  obviate  the  neevl  for  di.istic 
cortecf  ive  ['roceilures . 

FXAMPI.F:  In  one  inst.iiice,  the  need  for  .ulv.ince  pl.iiining  foi 

billeting  ree,ui  rement  s to  sui'port  testing  w.p;  identified. 

This  ident  i f icaf  ion  will  make  it  possible  to  .ivoui  .i  poten- 
tially very  expensive  solution. 

l.S  .'^UMMAKY  ANP  CONFI.t'SION. 


VALUES  FOR  SCHEDULE  SENSITIVITY  RANGE  AND  FOR  MANAGEMENT  RESERVE 
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IM'RODUC:  HON 


1.  Ackoff  and  limorv-  in  tlioir  liook  Ml  'Oi\  I’urpDSct'ul  Systems'  define 
information  as;  a commiin  i ea  t i on  that  (iroducos  a ciianj;e  in  ;iny  of  the 
receiver's  prohah  i I i t ies  of  clioice,  informs  him  and  hence  transmits 
information.  If  the  word  'data'  is  used  to  describe  the  contents  - 
.s>TnboIs,  words  or  numbers  - of  a communication  then  it  follows  that  not 
all  'data'  are  necessarilv  'information'  for  not  ever>-  part  of  every 
communication  influences  a receiver's  [ierce[)tion  of  the  choice  of  option 
open  to  him. 

1.  In  Defence  there  is  considerable  momentum  behind  the  detelopraent 
of  so-called  'information'  systems  (systems  that  acquire,  transmit  and 
process  battlefield  data) . I'heir  (lurpose  is  to  improve  the  iiuality  .uul 
timeliness  of  decisions  made  b>’  battlefield  commanders.  But  do  they'.' 

It  seems  fair  comment  a’'  the  moment  to  say  that  Oiierational 
Analysts  can  do  little  about  assessint;  the  value  of  investment  in  these 
systems  if  by  value  one  means  how  they  imi'rove  the  outcome  of  battle. 
This  is  for  lack  of  an  understanding;  of  what  'data'  .ire  'information'. 
Because  data  become  information  iinlv  in  the  miiul  ,ind  piereeiU  ion  of  the 
recipient  - a person  - such  an  understanding  can  onlv  be  obt, lined  from 
a basis  of  esjier iment s conducted  on  peoj'le.  In  D]'erat  i on.i  1 Rese.ircli 
terminolojjy  these  exi'criments  .ire  called  ,i;.imes.  \ithoui;h  games  have 
been  played  in  military  contexts  for  years,  few  of  them  have  been 
structured  in  a w.iy  that  enables  quant  i t .it  i ve  an.il>  sis  of  decisiv'ii 
making  to  be  made. 

4.  One  game  designed  to  do  this  is  vlescribed  in  this  jviper.  Ihc 
ideas  behind  it  rely  heavily  on  those  of  k i Bowen  wiio  in  .i  monogr.iph, 
now  in  press  (dl  , reviews  the  use  of  g.imes  .nul  presents  two  cl.issit'ic- 
ations,  one  for  their  iHir]iose,  the  other  for  their  structure.  i'he 
purpose  of  the  game  described  in  this  piaper  is  rese.irch.  The  object 

is  to  establish  a technique  to  invest  ig.ite  the  effect  of  dat.i  on  the 
quality  of  Command  decision  making  ;vnd  hv'r.ce  on  the  outcome  of  battle. 

'Fo  obtain  v(uant  it  at  i ve  results  the  structure  of  the  game  is  highlv 
controlled,  it  is  also  simple.  In  the  g.ime  v'ue  person  rei'resents  .i 
BLUL  (friendly)  Commander,  plavs  .igainst  i pre-det ermined  RID  thre.it 
(the  enemy)  and  makes  one  decision,  .it  this  point  the  game  is  termin.ited 
and  analysed.  In  Bowen's  c 1 .iss  i fic.it  i on  (d)  this  is  described  .is  .i 
'one  person  non-moil  if  iable  game'. 

5.  No  doubt  it  will  be  thought  th.it  such  .i  simple  g.ime  is  unre.i  1 i st  i c . 
It  is  hoped  that  this  jiaper  will  disj'el  .iny  such  ideas.  In  f.ict  there 
are  other  examples  of  games  of  similar  structure  quoted  in  (d''  ill  ot 
which  have  been  I'layed  successfully,  though  in  different  contexts. 
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Aiui  with  ;i  littio  inj;enuit>'  t lio  ['laM-r  ni.iv  lio  uii.iw.iii-  of  t Ik'  i.oiist  im  i iit  s 
I'l.ict'd  upon  him.  Tlio  r(.'asoii  for  I’lioos  i iii;  such  .1  simpU'  appro. ich  is  that, 
havini;  roviowed  the  possililo  si'eetrum  of  sanies  from  purel>'  automaton 
or  deterministic  ones  iiila>in>i  with  decision  rules  in  models)  to  those 
ittvolv  inji  both  Klin  and  Bl.lll  i'la>ers  (traditional  w.ir  yamesl,  it  ap|>ears 
to  be  the  one  that  can  produce  quant i tat i ce  results  in  practical  time- 
scales. I’urely  automaton  games  in  which  \arious  decision  rules  are 
e.\amined,  hive  been  used  in  deciding  wh.it  decisions  h.i\e  the  gre.itest 
potential  p.iyoff  and  are,  therefore,  wortli  .in.il>sing.  But  .iiitom.iton 
games,  b>'  their  nature,  do  not  re\eal  an>  thing  .ilioiit  t lie  behaviour  of 
people  nor  what  use  they  make  of  d.it.i.  Iwo  sided  w.ir  g. lining  h.is  been 
rejected  because  of  the  effort  needed  to  repl  ic.ite  suft'icient  g.imes 
for  statistical  validity.  Indeed  the  thought  of  .ins  form  of  intei'- 
active  gaming  has  been  put  to  one  side  until  some  basic  mulerst  .ind  ing 
can  be  gained  of  how  to  jilay  and  control  simple  g.imes. 

0.  The  rest  of  this  paper  will  describe  one  particul.ir  'one  person 
non-mod  i fi  ab  1 e ' game,  how  it  is  I'l.iied  and  wh.it  sort  of  results  c.in  be 
obtained  from  it.  Some  results  are  presented  from  the  t'lrst  series 
of  games  played.  Bor  these  games  [il.iiers  were  dr.iwn  from  re.ulili 
avail. ible  personnel.  They  did  nut  h.i\  e ilirect  experience  ot'  the  t'ornmand 
role  they  were  asked  to  plai’.  .\o  conclusions  dr.iwn  from  their  results, 
t'cerefore,  c.m  be  regarded  as  appl\ing  to  tlie  re.i  1 world  until  t he>' 
are  validated.  Bor  the  moment  tliey  demonstr.ite  a technique,  stiniul.ite 
discussion  .ind  suggest  hypotheses  th.it  might  be  the  subject  of  future 
games . 
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7.  IHiring  the  game  a i'la>'er  sits  at  .1  t.ible  in  .1  room  which  h.is 
suitable  maps  pinned  to  the  w.ill.  lie  is  told  that  he  is  to  play  the 
role  of  a l.ind  force  dommander  and  to  decide  when  .ind  where  to  deploy 
a reserve  formation  in  such  a way  as  to  h.ilt  the  enem\-  .idvanco,  or 
delay  it  for  .Is  long  as  possible,  .ind  to  inflict  the  m.iximiim  casualties, 
within  nominafevl  boundaries,  lie  is  given  data  on  the  progress  of  the 
battle  in  tlie  form  of  map  overlays  .ind  written  briefs.  The  written 
briefs  simulate  wh.it,  in  reality,  would  be  mostly  cerb.il  Intelligence  or 
Operations  reports.  They  are  written  so  th.it  the  experimenter  knows 
that  each  [ilayer  receives  exactli'  the  same  data.  It  is  felt  that  verb.il 
briefs,  though  more  realistic,  are  difficult  to  control  and  more 
liable  to  transmit  nuances. 

8.  B.ittlefield  data  are  heterogenous  and  for  an  initial  stud)'  it 
was  decided  to  group  all  types  into  one  of  four  sets: 

a.  Prior  Intelligence  - data  on  RIP  strengths,  locations, 
activities  and  intentions  collected  before  battle  commences. 

b.  Bar  Rlil)  Intelligence  - data  on  the  strength,  locations, 
act i ities,  intentions  and  groupings  of  RBH  units  out  of 
contact  with  BI.UB  forces. 

c.  Near  RliP  Intelligence  - as  in  b.  above  but  for  RIP 
units  in  contact. 


75A 


IM  III  I II I i'  I I I r.i'iu  r 


I'. 1 1. 1 I Diu  i' III!  ii'i  l|■|(•M^ll^  lnri'i's. 


In  tlii-.  niili.il  '.IiuIn  I uo  li'vcl  • 'I  c.u  h iil  l hi-  il.it.i  m'I  •-  wiMi'  iuv<'st\ 

.'’..Ill'll,  I 111'  .III'  ili".i  r I I'l'il  III  till-.  |i.i|'ii  .IS  'llii;ti'  .iiul  'll".'.  .Hill  t lu’V 

i'''n'i'-.|>i'iiil  1 1>  .1  iiiilit.ir'  ,1  PI' rci- 1 ,1 1 iKii  ul  t lu-  iii.i  \ i iiiuiii  .iiul  in  i ii  i miiiii  lli.it 

vi'ulil  I'l-  ri',1 1 1 -.  t 1 1' .1 1 I \ pi, Ill'll.  A'.  ,1  ii'iii'li  piiiil'  'llii’.li'  ii'r  ri’-.pi'iiil 
to  ol  .ill  till’  po-.-. it'll-  il.it.i  .iiiil  'll".'  I or  ri-spoiiil-.  to 

\t  .III  o.irli  't.ii'.i'  ol  1-..IIIU-  ilo-.ii’ii  It  ii.r.  ilo.  iili-.l  I li.il  -.otiu'  r.iiiiloiii 

1 11,11  ill  iMi' 1 fs  or  orror--  -.lioiilil  I'o  i iit  i o.liii  o.l  into  tin-  il.it.i,  .iiiil  pl.iic'r-. 

ii. iriioil  ol  this,  to  ri'ihii.  1-  t lu-  ,irt  i 1 ii  i 1 1 1 1 i tli.it  iiouUl  ro-.iilt  it  pl,i\i-r-- 

I’l- 1 i 1-1  i-il  111, it  i-vi-ri  1 t 0111  ol  il.it.i  ii.r.  .iiiiir.ili-  In  tin-  oii-nl,  it 

I omul  tli.it  till-  iiioi  it.il'li-  orrors  tli.il  i roppoil  up  iliiriii)-.  tin-  init  i.il 
il.ii.i  p rop.i  I'.i  I 1 on  Ill'll-  -.11 1 I 1 o 1 on  t 1 1 niiiiio  roii-. . .nul  -.o  ro.i  1 i -.  I i o . 111. it 

no  ill- 1 i lu- rn  1 1-  orror-.  iioro  nit  roihuoil . I'l-ool  ro.iiliiii-.  ol  il.it.i  I'riol-. 

.iiiil  iii.ip-.  ororl.iv'.  ii.i'.,  Ilioroloro,  lonlinoil  to  i o r roi  t i ur,  on  1 1 obiioii-- 

iii. ip  .Hill  iiios',.ii-,o  orroi's.  Iloiioior,  i.lu-tiu-r  or  not  i ii.u  on  r.ii  i o -•  .iro 

1 III  roiliii(-il  into  .iiii  )-..niu- . it  i -.  -.iii-.i’.i".  I oil  .i-.  .i  pri-i  .iii  I i on  lli.it  pl.iiors 
.iro  .ilii.ii'.  tolil  not  to  roi-.iiil  oiori  piooi-  ol  il.il.i  .i-.  noiO'.-.,ii  ili  oorroi  I . 

I'.I  t .1  r ro-.on  I .It  ion 

10.  \ pro  1 i 111  1 n.i  r 1 hi'iol  ooi  or  i ii;-,  I'l.lll  loiio-.,  h. it  Ilo  pi. in-,  .iiul 


ilop  1 

Ol  llll-ll  1 s , 

p 1 11'. 

wh.itovor  lo 

Vii'  1 

ol  I'l'ior 

1 111  o 1 1 1 1; 

onoo  on 

Kin  I'oi'ios 

.1  n- 

ho  in.;  p 1 .ii  oil  . 

I --  i;  1 t on  t o 

I’l 

.iiors  on 

1 ho  il.i i 

hot  oi  l- 

p ! ,11  1 it)'. 

1 ho 

)'..niio 

On  1 ho 

il.i  1 

ol'  till  l',.llllO 

.1 1 1 

il.it  ,1  .1  r 

o -oipp  1 1 o 

il  ,1'.  .1 

'.or  1 os 

o 1 

writ 

1 on  hr  1 o 1 

'.  to 

1 1 oiioil  hi  .111 

llpll 

.1  1 Oil  lll.ip 

o\  0 1 1 ,1 1 . 

Ot  oi  l 

.11'.  .110 

' prot  11 

.It  t 

1 \Oil  lilt  o 

r\  .1 1 

-.  ol'  h.it  1 1 o 

.Hill 

hot  woi-ii 

ot  or  1 .11  s 

pi  ,11  or-. 

roo  0 1 1 

1-  0 

il.it.i 

-.hoot  -. . 

Iho 

'.o  '1  shoot  '. 

,1  ro 

.ilw.ii-.  pro-. out  Oil 

in  oi'ili' 

r : 

.1  . .’tlioo 

t 1 

. 1 .Hill 

tl  Op 

ropi>il 

(Itllll  il.it.il. 

h.  .’Oioo 

t -. 

, h .Hill  S 

0 lilt  roporl 

(iio.ir  Kl 

0 il.it  ,1 1 

0 . ,’<hoo 

1 '.  .i 

. ('  .Hill  '• 

0 Ini  roport 

( I'.ir  Kl  1> 

il.i  1 .1 1 , 

A 1 1 hoiii-.h  o.ioli 

il.it 

.1  shoot  i s i; 

\ von 

.1  -u-p.ir 

.111-  il.ilo/ 

t i mo  )'  r 

oiip  t ho 

i .iro 

hiino 

hoil  into 

1 liro 

i-  '.ot  sol  t liroi- 

.Hill  not 

spro.iil  Of 

onli  111 

t 1 mo  s 

o t h.i  t 

.It  .1111  IllOIIIOIIt 

i 11 

)',.iiiio  t i mo  , t ho  p 

l.iior  h.i 

S ,1  I'Ollipl 

ot  o p 1 0 

liiro  ol 

wh.it 

rho 

i .iro  prosi-iitoil 

sop.l  I'.I  1 0 

1 1 so  th.it  ill  1 to 

rout  00 

'iiih  1 n 

.It  ion-,  ol  il.it 

.1  lo 

vol  I'.ui  hi-  ]' 

\^\K' 

il  hi  '.  iiiipli  oxi  h.in.i’,  i 11)'.  il 

,1 1 .1  '.ho 

ol  '.  . 

M.ip 

o\  or  1 .11  -. , 

10  r 

-.  i III  i 1 .1  r ro;i 

Mni‘- 

, .1  n'  ov>n 

'.t  nil' t Oil 

il  ■-  ,1  h.i 

so  ill'.p 

1 .1 1 1 111', 

low 

il.it  .1  w i t h 

-.u]'ploiiioiit  .irv  f 

1 1 

\\l\ioh  V 

oiivort  low  il.it.i 

to  hii'.h 

il.it  .1 . 

1 1 . 

t om!'  i n.i  t 

i on 

Ol  I'.it.i  Sols 

1 x.iminoil . 

IV  1 1 h l our 

il.il.i  -. 

ol  '.  .It 

t wo 

lovo 

-Is  1 lu-ro 

.1 1'l* 

It'  I'ossihlo 

ooiiih 

iii.it  ions 

ol'  il.it.i 

t h.i  1 ooii  1 il  ho 

p 1 ,ti  I'll 

In  oi'ilor  to  koop 

1 ho  init  i .1 1 

sillily  lo  ro 

,1  -lOii.ih  1 0 

proporl 

1 on '.  1 1 

W.t  '. 

ili-i'  i 

iloil  to  -.1 

Hill 

on  1 1 nino  ol 

tho 

so.  All 

ooi.ih  i II.I  1 

ion-.  1 11 

.0  h.ito 

t hroo 

il.it  .1 

- Ot  s .11 

.1  low-  lovol  wi-ro 

('\0 

1 Hill'll  on 

tho  I’.i'oiniils  th.it  tho  o 

\por  1 

IllOIlt 

i-r-.  h.iil  .1 

pro 

oonoi-pl  ion  t h.it 

'.-omh  i 11.1 1 

ion-,  with 

iiioro  il 

.1 1 .1  t h.in  t h 1 '. 

.ifo  nooiloil  lor  pooil  i|h.i  1 i t iloo  i -.  i on-,  to  ho  m.uk-.  llowoii-r  I ho  ooiiihiii- 
. It  ions  with  I'oiir  low  il.it.i  loii-l-.  w.n-  i no  1 luloil  .i-.  .i  ooiilrol.  In  .ulilition 
t ho  ooiiih  1 ii.i  I loll-,  in  wliioli  111. Ill  il.il.i  .in-  .it  .i  low  lovol  .iiul  No.ir  l.l  I’  .iro 


.It  a luy;li  li'vol  wore'  diso.ireloel  l'oo;uiso  it  w.is  tolt  th.it  pl.i\'i'rs  would 
t uul  this  oomh  inat  ii>n  uiiroa  I i st  i o . I'ho  vl.it.i  oomhin.it  uins  u^od  in  t ho 
iiuti.il  studs-  aro  stu'svn  in  I'ahlo  1. 
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1 J . In  ,inv  o\j'or\mont  ot  thi-.  '.v'Vt  t ho  an.ilsO  mu'O  ho  .ihlo  to  ulontits 
till'  I'ft'oot  I'll  t ho  ro-.ult''  that  tin’  u.itural  sariatioii'.  hotwoon  |'l,i\oi’s 
will  o.iiiso  .IS  woll  as  t lu'  I'riiiiars  suhioot  uiuior  i n\ o-.t  i ,o..i  t i on  whioh,  in 
this  o.iso.  is  t ho  lovol  ,iud  'spi-  ot  vl.it  a . K'  vh>  t h i . oithor  m.iin  ;;.iiiios 
with  o.uh  d.it.i  oi'iiih  I n.i  I I on  .iro  plavod,  and  t ho  ro.ults  .uor.ir.od  ovor  t ho 
I'l.isoi’s,  i<r  o.ioh  I’lasor  i’l.i>s  nioio  t h.in  oiu’  .o..imo . lu  t ho  lattor  o.iso 
t\'  ,i\oul  unw.iutod  I nt  s'l’.u  t ions  hotwoon  t ho  d.it.i  pro-.ontod  tv'  .v  pl.ivov 
in  I'lU'  i;.imo  ,iiul  vl.it.i  ii’.Ovl  in  I ho  iio\I.  vlittViont  '.oonaiu's  must  ho  ov'ii 
siruoti'vl,  with  I'l.i'ors  I'l.iviiii’,  oiu'  vt.iino  in  v'.ioh  .v  v'ti.i  r i v' , Iv'r  t ho 
initial  stiiilo  It  w.is  iii't  I'lavtual  to  pl.iv  iii.iii'  i',.iiiios  -.o  i ho  !',.imos  h.ul 

1 1>  ho  ,1  rr.ini'.i'vl  in  siuh  .i  w.i\  as  tv'  hi'  .iinon.ih  I v’  tv'  .in.ilvsi-.,  M,in>'  li'rm.il 
s t ,1 1 1 s t 1 V .1 1 vlosii'.ii’.  oxist  aiivl  .It  tor  imiv  h vl  i sous-.  i on  it  w.is  dovivlovl  to 
iiso  a l .ittiv  o Sv|u,iri'  vlosip.n.  This  vlv'stou  roi|uiros  v>n  I v si\  pl.ivors  aiul 

throo  siv-n, nil's  t\'r  si'iiu'  .in.il'si-v  tv'  ho  v.irriovl  I'lit  I'n  t ho  nino  vl.it.i 
oi'mhin at  ii'iis.  It  ,ilso  h.is  tho  honol'it  th.it  it  o.iii  ho  ropo.itoil  with  six 
mi'io  I'l.ixors  .It  .1  l.itor  vl.ito  tv'  p,  i \ i'  iiu'io  vlot.iilovl  rosults  it'  roi|uirovl. 
\n  uiuiorst  .iiivl  1 III’,  I'l  tho  vlosipn  is  lu't  noooss.ir'  in  v'lvlor  tv'  t'v'l  li'w  tho 
.irpumont in  this  p.ipor,  lu'woior  fv'i-  tlu'so  intorostoil  viot.iils  o.in  ho 
fv'unvl  111  i.'l  .uul  (U.  lahli'  11  shv'ws  wliivli  pl.i'ors  pl.ivoil  whioh  vl.it.i 
oi'tiih  in.it  ion  in  whioh  soon.irii'.  It  is  roooi’.n  i si’il  th.it  .it  this  st.ppo  it 

1 ••  iii't  pv'ssihli’  to  ohook  tho  x.ilivlitx  I't’  .I'.siiiiii't  i I'lis  vvn  iiv'riii.i  1 1 1 \ , 

.ivlil  1 1 1 \ 1 1 V ot'  orrors  I’to.  hut  tho  olu'ioo  of  this  vlo-iipn  ihios  not 

prooliiilo  'll  -.0  I't'  non  p.ir.imot  r lo  tost-,  whioh  vU'  iii't  rolv  I'li  t hoso 

.issumpt  ii'iis  .iiiil  .1  iiuiiihor  v't'  suoh  tost  , h.iW’  boon  iisovl. 
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ri-AYiiR  - si:i;naiuo  - hata  combinations 
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NOTIi:  riio  (.lata  combinations  playoil  In 

player  B are  repeat  oil  by  other  players 
in  tlie  same  scenarios.  This  is  an 
acciilent  of  the  (.lesii^n  aiul  is  of  no 
spec  i a 1 si  j;n i f icance . 

Scenaj'Jy  I’repyinit  ion 

13.  In  the  three  scenarios  a ilifferent  Klib  threat  >\as  posed  ayainst  an 
iinchantiinj:  inititil  Bl.llb  (.leji  1 ovinent . A Model  of  t('nibat  was  used  t (' 
simultite  the  projtress  of  battle  up  to  a jioint  at  whu'h  Ul  I'  broke  thri’uch 
the  forward  BLUl'  forces  with  the  reserves  uncommitted.  This  pro\ ided  a 
basis  for  construct  itii;  the  briefs  and  map  overla>s  t\'r  the  r.ames  as  well 
as  a metins  for  ,ana  1 \'s  init , in  a consistent  (|uant  i tat  i ve  wa>  .it'ter  the 
jtJimes  liad  been  played,  the  deployment  decisions  made  b>  the  players. 

I’J aitning  Aids 


14.  l.ach  player  is  required  to  deploy  the  rescines  fia'm  an  initial 
concent r;it  ion  area  in  such  a way  as  to  delay  the  enemy  ,uid  c.iuse  ma.vimum 
casualties  within  fixed  boundaries;  in  diMiiy  this  he  is  not  jn'riiiitted 
to  change  the  concepts  of  ojicrat  i tnis  or  plans  he  has  "inherited".  Two 
methods  of  planning  the  deiiloyment  of  the  resein  es  friMii  the  ci'iicent  r.it  u'n 
area  are  available  to  j'layers; 

a.  Contingency  Plans.  H'c'  initial  I'lanninp  Instructions  siipi-'lied 
to  the  [ilayer  before  the  paine  Rive  det.iils  of  .i  number  ot'  re.ili'-tic 
contiiiRoncy  plans  and  s('ecifies  the  deploMiient  time  fvir  c.ich. 

b.  New  Plans.  In  order  to  pive  the  pl.iyer  flexibility  to 
deploy  reserves  into  areas  not  included  in  the  coat  inRcncv  pi. in, 
he  is  Riven  a simple  ]ilamiinR  ,iid.  This  is  .i  me.isuruiR  rule 
RivitiR  movement  times  with  dist.uice,  on  the  s.uiie  sc.ilo  .is  t he 
map,  for  all  or  j'art  of  the  reserie,  |'lus  .i  '-t.itement  iM'  the  .niunint 


of  t imo  th.it  mu''t  bo  .ulJovI  t'vU'  rocoiin.i  i ^ ''.iik  o , in  oti. 

by  piiuiini;  this  on  t ho  map  iluriiu;  Iho  jmiik'  t ho  I'l.nor  o.in  f.ipiJlN 

calciilato  hi'w  lorn;  it  u i I 1 t.iko  to  ilo]'lo\  to  ,in\  loo.ition. 

fiul  of  t lio  liarno 

IS.  Iho  ganio  oniis  whon  blUl  vosorvt's  aro  i no\’ 1 1 .il' 1 \ oommittod  to 
fi.yhtini’,  RIM  in  .1  position  solootod  by  .i  pi.iyor,  or  KIP  liro.iks  throiiyh 
tho  torward  bl.Ul  dofonoos.  liamos  oontinuo  until  this  point  lor,  in 

sonio  situations,  playors'  dopUnmont  plans  oould  bo  altorod  as  a rosult 

of  frosh  inforiiiat  ion  that  booonios  availablo  botwoon  tho  rosorvo  boiny 
ordorod  to  movo  and  its  arrival  at  tho  solootid  point.  If  ooiulitivnis 
would  roa  1 i St  i ca  1 1 y allow  ,1  ohanyo  in  plan  to  bo  put  into  oi'l'oot  . t lu'ii 

this  is  allivvi'd.  In  sonio  oasos  it  is  qu  1 1 o difficult  to  dooiilo  whon  to 

t orm  1 ii.il  o vu  , .1 1 1 ornat  i VO  1 y , to  oontinuo  ,1  yaiiio  in  whioh  ,1  j'lavor  has 

niado  an  o.irU'  dooision.  without  y.iv  in);  him  int'orm.it  ion  or  makiiu;  him 

siis|' i 0 i oils  ot  his  dooision.  Iho  ro.ison  tor  want  in;;  to  torminato  a 
yamo  as  soon  as  iiossiblo  is  1 1'  minimiso  an>  food  back  to  tho  |'ta\or 
until  ho  h.is  plaiiwl  all  thri'o  y.amos.  Mthoin'.h  onl\  ono  dooision  is 
boiny  .in.ilysod  pl.nors  t ond  to  mako  tho  dooision  in  stay.os  In  oommittiny, 
rosor\  os  p 1 0001110,1 1 . 
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■Siibioot  ivo 

U>.  At  .1  (.lisoiission  fv'llowiny  tho  y.imo  sorios  .ill  |'l,i\ors  s.iid  th.it 
thoy  onioyod  tho  yamos  and  thouyht  th.it  t lun  woro  worthwhilo.  Tlun 
thoiiyht  that  tho  soonarios  wore  ro.ilistio  and  that  tho  I'roblom  was  not 
trivi.il.  Ivory  offort  was  m.ido  to  ini'oriii  tho  pj.iiors  th.it  somo  thoorios 
on  tho  uso  of  ilat.i  woro  uiulor  ov.imi nat  ii'ii  and  tlun  woro  not  boiny  tostoil 
.IS  individuals.  Ilowovor  pl.iyors  still  1‘olt  th.it  tlun  woro  iiiuior  prossiiro 
to  do  well  and  woro  obsorvod  to  bo  p.irt  i on  1 ,ir  1 \ tonso  in  thoir  first 
y.iiiio.  l.vory  yaiiio  was  monitorod  by  an  'bsortor  t'roiii  tho  o\]'or  i moiit  a 1 
toam  and,  sur]'r  i s i ny  1 >■ , thoro  .ippoarovl  to  bo  no  obvious  "rulo-pla\  iny" 
or  yaniosmanshiii. 

iliiant  i t at  i^o 

17.  To  holp  yaiiyo  tho  roaot  ion  of  plaiors  to  various  data  lovols,  to 
assoss  possiblo  loarniny  offoots  and  ohook  on  oonsistonoy  of  plav’ors, 
tlun  woro  all  t iniovl  whilst  roadiny  tho  dat.i.  It  was  omphasisod  to  ]ilayors 
that  a 1 1 lioiiyh  thoy  woro  boiny  timed  it  was  not  a raoo  and  thoy  woro  to 
tako  thoir  own  tiiiio.  A oonsidorablo  quantity  of  data  on  tlio  time  taken 
by  jilaxers  to  play  yames  and  read  the  data  briefs  was  ool  looted  atul 
.m.ilysed.  In  siitiiiiiain'  these  data  show  a hiyh  deyree  of  oonsistenv'y  in 
the  api'T'oaoh  to  the  yanie  by  the  indiviiliial  players.  There  is  also  st  rony 
evidenoe  to  siiyyest  that  any  loarniny  eft'eot  is  absorbed  diiriny  the  early 
part  of  a pl.iyer's  first  yaiiie.  This  oooiirs  well  before  he  has  to  take  a 
dooision  and  is  based  on  the  observation  that  players  took  a lonyer  time 
to  I'l.iy  the  earlier  stayes  of  their  first  yame  oomi'ared  to  the  series  as 
.1  whole.  riiere  is  also  some  evidenoe.  reinforced  by  subsequent  experiments, 
that  players  who  make  the  best  decision  take  lonyer  than  averaye  to  play 
the  yames- 
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I n t l\>dlK' t loll 

IS.  riuTi'  ,iri'  ,1  luiiiilur  ol  ol  iii.i  1 > s i ii)'.  > Ih'  rc.iilt'.  of  the  (|ii.ility 

ot'  ik'oisioiis  t.iki'ii  liy  t lu-  I'l.iyi'i"..  I lu'  ono  piTM'iit  oJ  in  this  |);i|H'r  is 
ilorivi'il  t'roiii  s iimi  1 .it  i iij;  t ho  j'l,i>ors'  ilooisioir,  in  tho  MoJi'l  ol'  fomh.it 
whioli  is  iisoil  to  y.onoiMto  tho  sooii.ir  ios.  11111111^  this  .in.ilysis  it 
hoo.iiiio  .iii|'.iroiit  til, It  ,1  |)lii)'or  ooiiKl  iii.iko  );ooi.l  luilj^nioiits  .ihoiit  tho  Jir- 
00 1 I oil  o t' t lu-  tlu'o.it  I'ut  poor  iudi'.iiK'iit  s on  tiiiiini;s,  so  th.it  .ilthoii>;h  ho 
know  whoro  to  soiul  li  i s rosorvos  ho  did  not  know  whon  to  solid  them.  This 

0. 1n  ho  dodiiood  hoonuso  pl.iyors  woro  .iskod  to  I'.ivo  wnniinK  ordors  to  tlioir 
rosorvos  .is  tlio  isiino  proyrossod , ,is  11  jpunl  foinmnndor  would  do  in  ronlity. 
It  is,  tlioroforo,  possiblo  to  ,in;il\so  intoiidod  doployniont  as  wo  1 1 as 
.lotu.il  doployniont. 

I'rosoiit  .It  i on  of  Kosults 

Id.  .Ml  ot'  tho  rosiilts  from  tho  initial  o.xjior  i iiiont  aro  shown  in  fiyiiro 

1.  I wo  iiio.isiiro  of  porforinanoos  ,iro  usod: 

.1.  tho  additional  nunibor  of  Kl'l>  units  dostrovod; 
b.  tho  additional  dolay  oausod; 

oom|iarod  to  what  would  havo  happonod  if  tho  rosorvo  hid  not  boon 
dop)(i)'od.  Thoso  .iro  o.xprossod  on  a jioroontayo  of  tho  iiia  i mum  jiossiblo 
scoros.  I'hoy  aro  tho  usual  moasuiH>iof  battlo  omplo\od  with  tho  modc’I. 

■fho  roason  for  usiny  two  inoasuros  is  that  thoy  aro  not  alw.iys  consist  out 
tluniyh  thoy  ajipoar  to  bo  so  in  thoso  rosults.  fho  fiyuro  includos 
results  for  a tost  playor  and  an  additional  |ioint  for  oach  sconario. 

I'his  additional  iioint  is  an  arbitrary  basis  for  oach  scon.irio  obtained 
whoti  tho  reserves  aro  dejiloyod  evenly  .icross  tho  front.  fho  roason  for 

includiny  this  is  ox|ilainod  in  parayraph  Jl.  It  can  bo  soon  from  this 

fiyiiro  that  some  rosults  stand  out  as  boiny  worse  than  tho  others.  fho 
points  .xT,  20  and  211  are  tho  cases  whoro  players  received  all  low  levels 
of  dat.i,  these  results  clearly  show  that  dat.i  does  havo  some  effect  on 

the  player's  ability  to  deploy  his  reserve.  fho  result  of  I’lasor  P in 

Scenario  1 (point  ll')  seems  anomalous.  In  tho  first  sconario  with  all 
high  levels  of  data  Tlayor  D dojiloyed  too  late  for  tho  rosorvos  to  i'l.i> 
any  useful  jiart  in  the  battlo.  In  tho  second,  with  all  low  levels  of 
d.ita  he  ayain  de])loycd  late,  in  the  third  his  deployment  was  bettor, 
and  achieved  a yood  result.  The  poor  result  in  sconario  2 miyht  bo 
expected  with  the  all  low  data  level,  but  tho  reason  for  the  first  result 
is  unknown.  It  is  impossible  to  say  from  tho  yamos  plaxod  whether  tho 
player  is  a late  deployer,  or  whether  ho  was  affected  by  nerves  or  just 
took  lonycr  to  lo.irn  his  role  in  tlio  yamo.  It  is  most  likely  to  bo  the 
first  as  he  performed  well  in  assessiny  tho  throat  (see  parayraph  KS) 
and  seemed  no  more  on  edye  than  the  other  ]i layers. 

Analysis  of  Results 

20.  The  analysis  of  the  results  that  follow  is  almost  all  based  on  tho 
measure  of  additional  Up.O  units  destroyed,  simil.ir  tests  c.irriod  out  on 
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tho  ottu'r  moasiiro  sivo  very  similar  results,  as  wmild  be  exiiected  witli 
two  iiieasures  so  closely  correlated. 


I 


Jl.  Iranst'ormat  ion  of  Results.  There  is  a jiood  reason  to  believe  that 
it  is  more  difficult  to  do  badly  in  scenario  2 compared  to  the  others. 

I'his  is  because  the  threat  in  Scenario  2 is  an  even  one  whilst  in  the 
other  two  it  is  as>Tnmetrical . This  is  illustrated  in  the  relative 
jHisition  in  tlie  three  scenarios  of  the  results  for  tlte  even  deployanent 
(points  IX,  2X  and  ?X  in  Tij^ure  1).  Althouj^li  all  the  analysis  whicli  is 
presented  subsequently  can  be  carried  out  on  the  data  points  of  i'igure 
1 it  is  easier  to  display  if  the  datum  points  IX,  2X  and  .SX  are  made  to 
coincide.  The  scenario  2 results  h.ive  therefore  been  adjusted  so  that 
the  datum  [loints  for  an  even  deiiloyment  and  the  best  (100"o)  deployment 
coincide  with  those  for  the  other  scenarios.  The  results  of  this 
transformation  are  given  in  figure  2 where  the  zero  point  corresponds  to 
the  even  deploymient  result.  It  is  now  clear  to  see  that,  as  in  Figure 
1,  fourteen  results  are  above  the  even  deiiloyment  result  and  six  are 
below. 

22.  Some  Observations  on  the  Results.  The  points  liave  been  marked  to 
show  those  which  were  achieved  with  a fairly  high  level  of  data  (.>  or 
4 high  levels')  and  tliosc  with  low  levels.  Apart  from  11'  it  can  be  seen 
that  better  results  were  achieved  with  higlier  levels  of  data,  assuming 
no  [ilayer  or  scenario  effect.  This  improvement  seems  to  be  only  marg.inal 
when  the  cases  where  players  had  all  low  data  (2F.  21'  and  .SI")  are  deleted, 
there  being  only  throe  points  not  near  the  top  group,  one  of  these  being 
a high  combination.  The  results  have  been  examined  to  see  how  indi\idu,il 
player's  results  are  distributed.  Figure  .S  shows  which  j^oints  correspoiul 
to  various  sets  of  players.  The  players  have  been  grou|H'd,  b>  inspection, 
into  three  sets: 

a.  Players  C and  F who  seem  consistently  better  tli.in 

the  rest. 

b.  Players  B and  1'  who  have  one  point  in  common. 

c.  Players  .A  and  F who  also  have  one  point  in  comiiuMi. 

In  Figure  .>  it  can  be  seen  that  Pl.iycrs  t'  and  F were  consistently  better, 
given  their  data  levels,  than  the  rem.iinder.  If  Pl.iyers  T .md  1 h.ul  high 
levels  of  data  then  it  would  be  impossible  from  the  gr.ii'hs  to  s.i\  whetlu-r 
it  was  the  players  or  the  data  t hatmproduced  better  results,  llowcxer 
Players  C and  F had  the  following  data  levels; 

hllUl,  i.illlll,  llill.ll,  lllll.l.,  111.1.11 . mil  I 

that  is  four  witli  two  of  the  data  set.  .it  .i  low  le\el  ,ind  two  with  onl\ 
one  data  set  at  a low  level.  Phis  iiulic.itcs  th.it  Pl.iyers  f .iiul  I did 
well  dcsi'ite  the  levels  of  dat.i  suiiplied  and  th.it,  given  no  scen.irio 
effect,  it  seems  that  the  better  the  dat.i  the  better  flieir  decisions. 

As  for  the  remainder,  they  did  no  better,  on  .ixer.ige.  th.in  thex  would  li.ixe 
done  had  they  followed  the  simple  rule  ot'  deploying  exenly  .icross  t he 
front.  Figure  4 sliows  which  results  corrcspvind  to  e.ich  scen.irio.  I rom 
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FtCURE  1 QUALITY  OF  DECISION  - RESULTS  GROUPED  BY  PLAYERS 

(EXCLUDING  TEST  PLAYER) 
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Iiiiuro  1 it  ai'iKMrs  tli.it  t ho  ilit't'oront  scenarios  hail  little  et't'oct  on 
those  results.  This  is  not  imexpe'teil  since  an  ail  just  men  t t'or  scen.irios 
has  heen  maile  in  the  scale  of  ineasiireineiit  . It  shoiilii  he  pointoil  out 
that  Scenario  1 was  always  jilayoil  first  by  each  jilayer. 

J.S.  Ranking  of  Pata.  If  one  assumes  there  is  no  variation  causeJ  *i 
scenarios  aiul  excluiles  I'laier  P (see  I'aiMgraph  IP)  then  the  effect  ot 
ilat.i  comh i nat  ions  can  he  rankoil  as  follows: 


1 ■ ' 
J • S ' P 

■1  ' S '•  0 

.s  - 4 - .S 

S 


Player  A 
l’la>er  R 
Plater  t' 
Player  I 
Player  V 


rhese  rankings  contain  no  inconsistencies.  (Inconsistencies  woiilil  he 
expected  if  d.ita  has  no  effect).  It  c.in  therefore  he  concluded  th.it  the 
data  is  not  inconsistent  with  the  htiiothesis  th.it  the  higher  level  of 
dat.i  received  the  hotter  the  ]iorform.ince  of  tlie  I'laver.  I'urthermore  the 
results  .ire  consistent  witli  the  experiment.il  te.im's  subjective  opinion 
that  jil.iyers  m.ide  use  of  tlie  data  in  tlie  order; 

Rl.liP  - Near  Ri;p  ' P.ir  RPP  ■'  I’rior 
I'urther  ivsults 

J4.  Following  the  analysis  of  the  initial  ex(U'riment , and  whilst  the 
results  were  being  discussed,  a further  three  players  hec.ime  available. 

It  was  decided  to  use  these  three  I'laxers  to  play  some  of  the  d.it.i 
combinations  which  had  been  omitted  from  the  first  exi'er iment . In 
retrosiH'Ct  it  apiieared  that  the  most  important  omissions  were  those  data 
combinations  that  contained  only  one  data  set  at  a high  level.  Puring 
the  first  series  of  games  the  observer  had  felt  tliat  jirior  intelligence 
was  having  least  effect,  or  being  least  used.  It  was  decided  tli.it  if 
prior  intelligence  was  kejit  at  a low  level  then  all  tlie  remaining 
combinations  in  which  one  of  the  other  three  data  sets  were  .it  .i  liigli 
level,  could  be  played.  The  next  tliree  players  were,  therefore,  used 
to  play  each  combination  in  a .>X.>  Latin  .Square  experimental  design. 

Ihe  conclusions  jiresented  in  the  following  paragraph  are  based  on 
analysis  of  the  initial  exiieriment  (ilus  the  results  of  these  three 
additional  players. 

CO.NCl.llSIONS 


J.S.  Pespite  the  largo  player  differences  which  occurred  in  both  sets 
of  games,  and  which  is  of  interest  in  itself,  analysis  has  shown  that 
the  levels  of  data  do  affect  the  (lerformance  of  itlayers.  If  the  results 
are  grouped  according  to  the  number  of  data  sets  presented  to  the 
players  at  a higli  level  then  't'  tests  and  Kilcoxon  rank  - sum  tests 
(the  latter  being  non-parametric)  show  significant  differences  (at  the 
97.5“o  level).  Significant  differences  occur  between  games  played  with 
all  data  sets  at  a low  level  and  those  with  one  high  and  three  low  sets. 
Significant  differences  also  occur  between  the  'one  high  three  low' 
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games  and  the  'three  high  one  low'  games.  The  average  result  for  the 
'two  high'  games  lies  between  the  'one  high'  and  'three  high'  cases 
but  the  differences  between  them  are  not  significant.  From  this  it  can 
be  firmly  postulated  that  players,  irrespective  of  the  quality  of  their 
own  overall  achievement,  perform  significantly  better  the  higher  the 
level  of  data  supplied. 

26.  In  addition  the  results  have  been  analysed  to  try  to  detect  any 
significant  differences  between  data  types.  The  tests  show  that  raising 
one  data  type  (other  than  prior  data  which  was  not  tested)  from  the  all 
low  case  always  leads  to  a significant  (95%  level)  improvement  in  the 
results  but  that  no  one  data  set  gives  rise  to  a more  significant 
increase  than  any  other.  It  is  clear  from  this  that  one  type  of  data 
is  being  substituted  for  another  and  that  in  the  particular  command 
decision  examined  there  is  no  one  set  of  data  which  is  of  overriding 
importance.  Because  of  the  small  sample  it  is  impossible  to  analyse 
whether  the  value  of  one  type  of  data  is  affected  by  the  presence  or 
absence  of  another  set.  Many  players  believe  that  combination  effects 
such  as  these  are  important  and  have  proposed  various  hypotheses  One 
such  hypothesis  is  that  high  levels  of  far  RFD  data  are  only  of  value 
when  combined  with  high  levels  of  prior  intelligence.  This  particular 
h>'}5othesis  can  be  shown  to  be  false  from  the  conclusion  reached  at  the 
beginning  of  this  paragrajih.  Other  hypotheses  will  go  untested  until 
more  data  is  available. 


CAVFATS 

27.  As  the  games  are  intended  to  evaluate  only  certain  types  of  data 
other  factors  that  would  normally  influence  the  decision-maker  need  to 
be  stated  and  clearly  identified  as  not  being  part  of  the  game.  While 
this  is  apparently  quite  straight  forward  from  the  analytical  point 
of  view,  it  must  be  appreciated  that  command  entails  the  complex 
balancing  of  numerous  factors  and  when  restricted  to  considering  only 
three  or  four  of  them,  the  player  acting  as  commander  may  produce  a 
different  answer  to  that  which  he  would  have  produced  as  a real 
commander. 


28.  The  games  are  designed  so  that  the  commander  can  make  the  critical 
decisions  in  the  absence  of  the  normal  headquarter  staff.  This  situation 
is  unrealistic  as  the  player/commander  is  devoid  of  normal  specialist 
advisers  and  he  has  no  filter  between  him  and  a certain  amount  of 
unprocessed  data.  This  may  possibly  lead  a player  to  perform  the  task 
of  intelligence  staff  officer,  perhaps  at  the  expense  of  his  ability  to 
make  command  decisions. 


FOOTNOTF 

29.  The  author  and  his  study  team  are  convinced  that  this  type  of  game 
is  sufficiently  realistic  to  provide  a framework  for  the  study  of  battle- 
field decision  making.  It  is  simple,  quick  and  cheap  to  develop  and  run. 
It  provides  the  opportunity  for  establishing  a foundation  of  knowledge  of 
human  decision  taking,  based  on  quantitative,  statistically  valid,  results 
But  even  so  the  amount  of  painstaking  analysis  that  needs  to  be  done  on 
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rosolviti};  fundamental  iiuestions  is  daunting.  One  way  in  wliich  it  may  be 
jiossible  to  extract  more  information  from  each  game  is  to  ask  the  player 
to  say  what  decision  he  would  have  taken  at  various  decision  points  in 
the  game  even  though  these  decisions,  unless  they  coincide  with  ttie 
pre-determined  scenario,  are  not  implemented.  In  other  words  to  get  tlie 
(■•layer  to  act  as  an  adviser  rather  tlian  decision  taker.  The  uevice  or 
trick  of  making  a player  believe  he  is  advising  another  (ilayer,  remote 
from  him, was  first  pro(iosed  in  a .Sussex  University  |)ai)er  (5)  as  a wav' 
of  introducing  players  to  [vre-determincd  situations  and  to  kee[)  a player 
interested  in  playing  a game  in  which  his  decisions  are  not  im]ilemented . 

If  it  can  be  shown  tnat  in  these  circumstances  ttie  advice  a [)la>er  gives 
coincides  with  tlie  decision  he  would  Ivave  taken  tlven  more  tliau  one  di'.  i';iou 
(H'int  c.in  be  investigated  in  each  game,  i'iiis  [>oss  i hi  1 ’ t >■  is  the  subject  of 
.in  investigation  by  tlie  study  t e.im  at  the  moment. 

<£)  Controller,  Her  Majesty's  Stationery  Office  London  H)77 

An>  views  e.\[)ressed  are  those  of  the  author  and  do  not  necessarily 
represent  those  of  the  Ministry  of  Defence. 
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ABSTRACT 


In  January  1976  , CCLC  v.as  diroctod  to  expand  its  testing  program  to 
include  the  evaluation  of  training  prcgraris  , devices  and  techniques. 
Consequently,  ive  nov.'  incorporate  ti-aining  oojectives  in  our  Combat 
Developi"ents  Experii.ents  are  tiave  begun  to  design  discrete  training 
tests.  Since  there  nave  been  fev.'  prior  attempts  to  collect  quanta- 
tive  training  data,  toe  selection  of  training  I'.Cls  can  be  a difficult 
task.  In  addition,  qualitative  training  infonr.ation  can  provide  valu- 
able assistance  in  th.e  evaluation  of  training  programs,  and  should, 
therefore,  also  be  collectea  and  reported  as  part  of  the  field  tost. 
This  paper  discusses  tiou'  training  has  been  incorporated  into  CDLC's 
mission;  gives  examples  of  training  EEAs  and  MOCs  v.hich  have  been  used 
at  CDEC;  and  concludes  uit’i  a presentation  of  training  results  from 
some  recent  CDEC  experii'ents . 
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I.  IHIRODUCl  lU.N 


lfi  i\\iui>u-y  I'V/ii,  IKAIXIC  taski'il  CPU'  to  ("'.iMtul  its  It'stinu  pfiuiiMin  to  in- 
cluilo  till'  colloition  ot  il.it, I ivhult  i .ui  tu-  iist'.l  to  su(  (uirt  tlio  di'vo  lopmoii  t 
and  ov.iluation  ol  tiainimi  pro.ir.iias  , dovin's  .uul  toi  hn  i .pu’s  . Spoi  1 1 u .1 1 ly  , 
CULC  (r.iiniiui  support  now  iiivolvos:  Iho  i oiuiiu  t of  disiis'tt'  trainnuj 
tests;  ttio  iiu'lusion  01  trawnno  add-c>ns  to  ;'oii;lMt  Prvolopmi'nt  losts  ttor 
ox.iiiiplo,  tlio  1.0I  loot  ion  ot  APllP  1 nt  oriii.i  t 1 on  ) ; tin'  roviow  ot  solorti’d 
prior  oxporiiiionts  tiir  tiu'  purposi'  ot  .itr.  t r.ir  1 1 lui  tr.iinina  1 ntoriii.i  1 1 on . 


• Conduct  Disrroto  Ir.iiniiui  losts 

• liu  lihio  liMiniiui  I'l'.iiH  t i VOS  in 
CoiiilMt  Dovo  I opison  t losts 


CPU'  Iraininp  Support 


In  ordor  to  oon;[il\'  witli  our  lu'w  t.isk,  CPU'  tr.iini  i'i  aUivilios  li.iV('  toui-.o.! 
on  four  iiiiijor  aiasis.  llio\  .iro:  Alti'nd.inoo  at  v.irious  . I'orO  1 n.i  t 1 on  moot  1 nos  . 
compilation  ot  tr.iinino  ilat.i  I roin  prior  t'l'U.  tosts;  1 noorpor.i  t 1 on  ot  tr.iinino 
object  ivos  in  ooml’.it  .lo\o  lop.'ont  oxf'or  imi'ii  ts  ; .in.il'.sis  ot  tr.iiniro  d.it.i  1 ro;a 
seloctoi.1  oxporimonts.  i.uli  01  tliosi-  aro.is  will  now  I'o  .uidrossod  in  dotail. 


• Coor.i  i n.i  1 1 on  with  otiior  IKAIHU'  Aoonoit's 

• Comp  1 1 .1 1 i, 'll  and  Pi  ssi’iia  n.i  I i I'n  ot  irain- 
1110  1 nt I'rm.i t 1 on  t nmi  Prior  I'Pi  C losts 

• Co  1 loi  1 1 on  ol  ] ra  1 111  no  P.i  t a 

• An.il.s  s i s/U  .il  ua  t 1 on  ot  ir.iiniiui  P.ita 


CPI  t'  I r.i  1 ni  no  A.  t u 1 t 10s 


II.  COOKPIN'Al  lUJ  AC  I IVll  1;  s 

Initi.il  Cl'l  C I'oori!  1 n.i  I i on  Ailuitios  i.i'ia'  tor  tho  purrosn  ot  .!;■  t or;':  1 n 1 n.; 
how  wo  could  suppi’ft  too  trainin.)  .o:'..unit\.  As  a ro.ult  I'l  Oi.r  I'arl', 
activitv,  wi'  ilocolopisl  linos  01  . ommun  u .1 1 1 on  , t's  t aP  1 1 stus.  point'.  01  . .'ii 
tact  .ind  idontitii’d  potonti.il  users  ol  our  Iraimii.i  .Ml.i.  iollo..ina  tni- 
initial  period,  wi'  thini  unoortook  to  I'rioi  intoro-.tod  IKAiW  .loor.  10s  ,'n 
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our  tostitui  Kuilit\  vKivl  tk'  uliiili  tr.iitim.j  uums  cOuKl  [<o\l  lio 

supportOkl  il'LC  k'atu  t roia  i ns  t rur.  ciiti'kl  ('nn.n’i'iri'nt  birujlatioti 

0!«.0i\:i  SOS  ) . Our  rokont  aotuity  has  iru'i'lvt\l  p.i  rt  i a i [m  t i on  in  r.oi'tiiu.'s 
cfosikinokl  to  cOiirJinato  (lie  efforts  of  v>irjo(;s  iOAPk'O  aifoncios  invohiJ 
in  tiio  dovo  Ik'pafL’iit , kOlh'Ctuni  aiul  uso  of'  tiMinimj  i nt  k'rma  l i on , Itns 
latest  kU'tivity  slu)ulkl  ipwitlv  afOiist  ttu.*  trainino  lars  suti  1 1 hv  isi  niini  ji  lui 
the  duplication  of  oitk'rt  '.'.nikh  kan  result  whk'ii  prku;raias  are  dk'velopk-d  in 
isolation. 


UAIj 
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U AIA 
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mi 

OSAIS 
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klflllS) 

MAt! 
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77 

HO  IKAn'i 
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V Oi'isl)  nat  ion 

JOL 

77 

isn-us/ARi 

Alkltt'  l-.oi  king  lOkUil' 

JOL 

77 

No  Ills  Af  6 

lllAOk'k,  t OSSkk'M  Ir.iinin,]  k'onloii'iuo 

JOL 

77 

Ism  - ns.  ARi 

liSkS;  lor  Alls  nil' 

Sir 

77 

AKl 

U'l\  on  [valuator's  tnjwlot'ook  for 
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SK’ 

77 

Hlf  lILAOJC 
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SI  r 

77 

C7\L 

NIC  I'k’ki'loi'ii-k'nt  k'ontoi  oiu n 

Prior  ( PI  C Ir.iiniO'j  Coortii  na  1 1 on  AMIvitU'S 


III.  DATA  COMPILATION  ACTIVITIES. 


In  light  of  our  now  assigniront,  prior  CDEC  tests  were  reviewed  in  order  to 
determine  if  additional  infurnation,  specifically  addressing  training, 
could  be  abstracted..  We  identified  five  areas  for  further  review  and  cur-, 
rently  plan  to  publish  the  following  Training  Reports  this  year: 

0 TOW  Training  Report  (Published  March  1977) 

• Tank  Training  Report  (Draft  Completed) 

• Detection/Acquisition/Ranging  Training  Report  (Draft  Completed) 

• Aviation  Training  Report  (Research  in  Progress) 

• DRAGON  Training  Report 

Although  each  report  is  organized  in  a slightly  different  manner,  all  will 
contain  both  quant i tat i ve  and  qualitative  training  or  training  related  data. 
Each  training  report  is  intended  to  provide  a concise  review  of  training 
information  collected  in  prior  CDEC  tests.  For  example,  the  TOW  Training 
Report  which  was  comitleted  in  March,  contains  two  sections:  The  first  des- 
cribes the  TOW  training  program  conducted  for  the  Tactical  Effectiveness  of 
Mine  Fields  in  the  Anti-Armor  Weapons  System  (TEMAWS)  Experin\enf.  the  second 
section  lists  TOW  training  information  collected  from  four  previous  CDEC 
experiments.  Some  examples  are  listed  below. 

• TOW  gunner  performance  is  degraded  when  a blast  simulator  is 
used  (TEMAWS  lOW  Training  Program) 

• More  difficult  for  ATM  gunners  to  track  target  during  live 
fire  than  during  training  (TETAM) 

t Expended  ATM  guidance  wire  on  battlefield  will  be  hazardous 
(TETAM) 

• Need  portable  TOW  battery  charging  system  (ATMT) 

• Aim  point  for  target  whose  aspect  is  continually  changing 
not  specified  in  training  programs  (ATMT) 

t Ranging  more  difficult  than  tracking  (TAHOE) 

• Difficulty  transferring  from  visual  to  optical  acquisition  (TAHOE) 

• Two  weeks  required  to  transfer  skills  of  qualified  TOW  gunner  to 
erectablc  systems  (ITV) 

• Tracking  proficiency  was  increased  by  use  of  inexpensive  training 
aid  (Emerson)! ITV) 
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IV.  COLLLCTION  OF  TPvMriirJG  DATA 


The  third,  and  most  important  area  of  CDtC  activity,  is  the  collection 
of  traininq  data  from  our  field  ex(ieri)r,onts . This  has  involved  supple- 
menting previously  scheduled  Combat  Development  tests  with  training 
add-on  requirements  and  me  dovelo()mcnt  and  execution  of  discrete 
traininq  tests.  Dotii  quantitative  and  qualitative  traininq  information 
can  be  collected  from  th.eso  tests.  However,  since  tfiere  have  been  few 
prior  attemjits  to  collect  quantitative  training  data,  the  selection  of 
traininq  tiOLs  has  been  a difficult  task. 

A.  Training  Add-Ons 

Initially,  CDC  Pam  71-1,  "Force  Developments,  the  r'easurement  of  effec- 
tiveness", was  used  as  a refcroiicc  and  relatively  siirple  training  add-on 
objectives  v.'cre  specified.  F.xaiiples  of  some  early  training  U.As  and  NCDs 
are  listed  below: 


J He  IJjLTK''  ter  Opera  tiongl  Pyperi  i-er.t  (TAMPP) 


ED/'  1 • How  is  TCVl  gunner  performince  affected  by 

learning  tliroughout  conduct  of  t.'ie  test? 


HOE  1 • Average  gunner  tracking  error  at  end 

of  record  trails- 
Averao('  ouiuK'r  tracking  error  at 
I'C ginning  of  record  trials. 

HOC  2 • Distriluiti  on  of  gunner  tracl.ing  error 

as  a function  of  nuivber  cf  trials  per 
I', layer  or  group. 


EEA  2 0 How  does  fatigue  affect  TCH  gunner  nerfor- 

nvince? 


fldC  3 • /''verage  iiuniu'r  tracking  error  during 

1st  trials  of  the  day- 
Aierage  runner  trackiiii,'  error  during 
Kijt  2 trials  of  the  day. 


HOE.  ‘1  • Di  st  I'i  Init  i on  of  runner  trackino  (-rror 

as  a function  of  nuiher  of  trials  per 
player  or  group  per  day. 


r 
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Evaliiation  of  tlio  Frontol  Pai\inot  Foxhole, 

'Part  vTiTP/^RTOX  Vl'll 

EEA  1 • How  is  player  survivability  affected  by 

traininn  over  the  duration  of  the  trials? 

MOE  1 • Multiple  evaluation  (e.c.,  tirv  until 

casualty,  ranee  until  casualty,  etc.)- 

EEA  2 • Are  the  attitudes  of  nKiycr  personnel 

towards  tlic  effectiveness  of  the  narapet 
foxiiole  chanoed  as  tiiey  becon'o  better 
trained  and  mre  experienced? 

fXlE  2 • The  player  averaoe  rankinn  of  the  tiu'cc 

foxholes  (1  = most  effective;  3 = least 
effective)  at  the  beginnina  of  n^cord 
trials  and  at  the  conclusion  of  record 
trials. 

EEA  3 0 Poes  pla.\  er  performatice/at  ti  t ude  (enthu- 

siasm for  traininn)  improve  or  rep’ain  at  a 
hinh  state  with  tlio  use  of  IPFS  treal  tine 
casualty  assessment)? 

WE  3 • The  number  of  players  who  subjecti  vol  v 

think  training  vn' th  tlie  UTS  is  bettor 
than  previous  traininn  t!'.-.".  have 
cxooriei'icod,  at  live  start  oi,  tne 
middle  o'",  and  the  end  of  record  trials. 


As  wo  gained  experience  and  had  an  onnortunitv  to  interface  witli  nwri' 
of  the  traininn  community,  our  cnlloction  of  Lrainirn  data  i.as  botti'r 
able  to  reflect  specific  user  needs.  For  example,  the  followino  iiii'Pl 
IIA  and  MAP  PRO  III  training  add-ons  v.ore  dove  1 one  d in  conjunction  wi  tli 
the  proponent. 


Ilioh  Mcbi  li  tv/Aoi  1 i tv,  D'aso  IJA 

(iiTt'A'i;  riA)' 


LEA  1 • What  arvunt  of  retraining  is  reguirod  to 

ivqualify  TOW  gunners  to  their  lotmvr 
level ? 

MOE  1 • Training  tiw  (days)  to  ivqualify  ICW 

gunners  (equal  or  lunher  level). 
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2 0 Cciii  conlor  of  (COf  ) tf oi n i I'o 

ir'pt'ove  Uic  ovinnor'r.  ability  lo 
ttolcn..ii!o  li'.e  tanjol's  true  conlor 
of  iiiasb? 


IViE  ? • /'voiMOC  ail"  error  fron  t ri,o 

conlor  of  (COr  ) ijofero 

cot:  trail. ir.o  (a.-inulii  aiul 
ol ovation  orror). 

min  us 

Avc.raoe  aim  orror  from  true 
con  tor  of  mass  (COf)  altor 
cot;  tra  ininn  (.lai  irutli  and 
elevation  orror). 

3 e l!ov,'  effective  is  fCOAl  train  inn? 

MOL  3 • Avorane  orror  in  load  aiuilo 

before  lead  trainino. 
minus 

Averacio  error  in  lead  an>|le 
after  load  trainino. 


Tes t 0 f_ia'w_jan 1-- 

i'l'uduc  ts , T’iiaso  i l l 


3 • Hon  effective  is  tiie  trainino 

p roe  rain? 

MCIL  1 • ffC  tost  scores  after  trainino- 

TtC  test  scores  before  trainino 


T.,„1,  ,MUI  (TAHi!  t.«t  f’,’; 

Ani,i.  7V:s  .u.,-  ia;'i  v 

)::5 iK;n:'™id.t,.no„.  .uo  >.y  u.., 

d by  area  bad  lioon  scheduled  foi  coUoClIOii. 


^ AMI  T ra  i n i n nJ'hlL'L,l’y,2.'l^’i:- 

• Are  nrocedures  satisfactory  or  unsatisfactory? 

• Was  mission  acconol  isliod? 
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• If  procodi;rcs  i.cre  satisfactory  and  mission  failed, 
what  caused  failure? 

f If  procedures  wore  unsatisfactory  and  mission  v;as 
accomplished,  to  what  is  success  attributed? 

t What  are  required  subtasls? 

• V.'hat  are  bottlenecks? 


• What  aspects  of  task  need  addi tional/less  emphasis 
in  training  procraris? 


TA^'I  Trainino  Data  by  Area 

Planning 

• Did  the  tean’  coirrander  develop  a sound  tactical  plan 
based  on  the  information  available? 

• Were  the  essential  elements  of  this  plan  communicated 
to  platoon  leaders,  the  FO  and  separate  section 
leaders? 

Movement  Techniques 

• How  far  ahead  of  the  main  attach  force  was  the  point 
element  traveling? 

• What  percentage  of  the  attack  force  (combat  vehicles) 
were  visible  prior  to  contact  being  initiated  at  the 
final  objective?  (Observations  taken  from  several 
enemy  vantage  points). 

Intel li oence 


t Did  the  team  commander  determine  the  location  of  the 
main  defensive  force  (accurately  enouoh  to  employ 
effective  supf)orting  fires)  prior  to  his  own  attacking 
elements  becoming  decisively  engaged? 


Execution 


• Did  the  team  effectively  suppress  the  main  defensive 
force  during  the  final  attack  (direct  or  indirect 
fi  res)? 
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• Did  the  team  conTV.ndcr  adjust  his  raneuvcr  olcr'onts 
subsequent  to  contact  to  n'axiir.ize  liis  contat  pover 
Cniancuver  to  one  flank  or  the  other,  concentrate  his 
force  against  a vieak  point  in  the  defense)? 

• l.'hat  percentage  of  the  irajor  eneniy  weapons  v.'orc 
destroyed  by  indirect  firc,  tanks,  TOW's,  other 
infantry  weapons? 


We  worked  closely  with  TSI'-TtS,  AKI , the  Ani«r  School  and  those  involved 
in  the  devolooiwnt  of  .'latinnal  Training  Centers  in  order  to  dovelo'''  T/'f'l 
training  objectives.  Additional  training  infonration  was  to  have  boon 
derived  from  the  objective  data  (!;i  1 1/casual  tv  ratios,  'I'laver  Iccation 
as  a function  of  tire,  player  posture  as  a function  of  tire,  etc.),  that 
would  have  been  collected  durinn  the  conduct  of  a trial.  The  final 
disposition  of  TA.'h  will  bo  decided  at  the  A'oveirher  TSAPC.  Currently, 
it  has  been  postponed  indefinitely. 

B.  DISCRETE  TRAINING  TESTS 

CPEC  has  conducted  one  stand-alone  or  discrete  training  test,  Heliconter 
Operations  in  a hieht  Environment  Aciainst  a Simulated  tlireat  (IIOhEST  I), 
and  plans  to  field  DRAGOh  Training  Effecti venoss  Analysis  (TEA)  in  78-79, 
and  IICl!  ARIEP  in  4th  Q 78.  !n  HO.'IEST  I,  a training  nropram  for  pilots 
using  night  tactical  operations  in  terrain  level  flying,  was  developed. 


0 Developed  training  prooram  for  pilots 
using  niclit  tactical  o'H'rations  in 
terrain  level  flying  (with  and  without 
nigiit  vision  goggles) 

• Identified  short-coming  of  an  AN/PVS-5 
goggles 


RESULTS  or  liOk'EST  I 


The  DRAGO:,'  training  effectiveness  analysis  is  a three  phased  e.\periment 
desiened  to:  Coirpare  alternate  trainino  pronra'-s ; to  assist  in  tite 
evaluation  of  pronosed  ountier  selection  criteria;  to  evaluate  selected 
trainino  scorine  rv'tliocs  ; to  cci  earo  the  ctiect  ot  the  addition  ol  one 
training  round;  to  ce"'aiv  refreslier  trainino  prooraiis;  and  to  identify 
gunner  retention  ctirves.  .-’.n  Outline  Test  Plan  tor  this  test  has  been 
developed  in  conjunction  with  tlie  Infantry  School  and  subrntted  to  IIQ, 
IR/MXIC. 
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• Compare  training  programs 

• Assist  in  the  validation  of  proposed 
gunner  selection  criteria 

• Evaluate  selected  training  scoring  methods 

• Compare  effect  of  addition  of  one  training 
missile 

t Compare  refresher  training  programs 

• Identify  retention  curve 


OBJECTIVES  OF  DRAGON  TEA  TEST 

USAIS  is  also  the  proponent  for  the  Mechanized  ARTEP  test.  The  purpose 
of  NECH  ARTEP  is  to  generate  data  from  which  to  assess  the  ability  of 
umpires  to  evaluate  a mecl'.anized  infantry  platoon's  execution  of  selected 
ARTEP  missions.  The  results  of  this  experiment  may  be  used  to  revise  or 
nxidify  the  evaluator  training  program  and  evaluation  techniques.  The 
specific  objectives  of  the  tost  are  listed  belov/. 


• Deterp’.ine  how  well  evaluators  judge  unit's  1 

performance  j 

• Identify  areas  of  selected  ARTEP  missions 
that  are  most  difficult  to  evaluate 

• Recommend  changes  to  evaluator  training 
progrars 

• Provide  insights  into  techniques  cf  oval-  I 
uati on 

• Provide  insiolit  into  validitv  of  selected 
aspects  of  Mechanized  Infantry  ARIEPS 


OBJECTIVES  OF  ME  CM  ARTEP  TEST 
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V. 


A-IALYSIS  AMD  F.VALUATlCr,  OF  TIIAIMMO  DATA 


The  analysis  and  evaluation  of  tnaininn  data  has  heon  initiated  at  CDlC 
durinq  the  last  year  and  a half;  (juanti  tati  ve  and  qualitative  traininn 
infon'uition  can  he  found  in  bnifi  the  resi:octi\o  final  Ferorts  and  in  tl'i.' 
Final  Report  Suyploirents  titled  "Military  Ct’Servations".  1 lie  folloaino 
four  tests  have  Peon  cnosen  to  demonstrate  tiie  tyne  of  trainine  informa- 
tion which  has  been  obtained  frem  a field  test  en\ i ronmen t.  !'er  your 
convenience.  I've  also  incluaed  a brief  description  of  tiie  experiirent. 

For  a rore  detailed  explanation  of  t.ho  ti'st  and  its  results,  nurnise  reter 
to  the  experi rents'  final  iv,  ort  wnich  can  be  obtained  t.hrouaii  DDd. 

A.  CDFC  Fynorirent  FC  Oaf.  Fvaluation  of  t.ho  .'"rental  '’.'raoet  rox''olo, 
Part  7 IpARFOX  V'llA,  reFfc. 


1.  Purpose.  PA,''F0.\  VI 1 was  an  infantry  foree-on- feree  scientific 
field  experiment  conducted  to  collect  data  in  a realistic  combat  enviren- 
nent  for  the  purpose  of  maf.ino  a comparative  evaluation  of  the  frontal 
parapet  foxhole,  the  soli:  :'arapet  foxhole,  and  the  standard  toxhole. 

The  results  of  tins  exnerirxnt  nave  been  used  by  the  DSAIS  and  TPAiAV  to 
determine  doctrine  for  the  construction  and  orpleyrent  of  intanti’y  fiuhtine 
posi tions. 

2.  ^Jiccb_f-  Ttie  experiment  consisted  of  a series  of  trials  in 

which  an  infantry  platoon  ccnsistinc  of  tliree  squads  conducted  coordinated 
attacks  against  a prepared  S'uad  defensive  position.  Lascr-equi pned 
weapons,  hand  prenades  and  iiwiirect  fine  simulations,  and  continuous 

communication  between  eac'i  seldipn  and  a computer  einbled  Ci'FC  to  create 

a realistic  battlefield  eiuircnmont  in  w.hicli  casualties  wore  assessed  as 
they  occurred.  Siinnressive  cues  were  also  fed  to  t.he  players  as  tiio 
tactical  situation  dictated. 

3.  D'vsmi.  Fach  trial  qenerated  two-sided,  real-time,  target 

acquisition  and  enoaueixont  sequences.  These  resulted  in  real-tiro 
casualty  assessrenl  and  attrition  in  a five  play  onvi  ronrx'nt.  Irials 
examined  only  that  PO)'tion  of  tiio  i'altlo  which  too.k  rlaco  within  L'Dd-L'bD 

mctci's  of  the  FLDA.  Thiro  cefondinq  and  tiireo  attacking  (throat.)  pl,\vor 

sets  conducted  approxirxUoly  150  trials  over  a throe  month  period  vrlth 
each  player  set  parti  ci  rat  in.;  almost  daily  in  ene-ti',ird  of  those  trials. 
Both  day  and  niqht  trials  were  conducted  on  tluve  different  terrain  sites. 

A.  PI. aver  Profi rienc.v.  Every  effort  was  made  to  nroviile  tactical 
realism  for  the  player  personnel  provided  by  a TO.'II.  infantry  battalion 
from  the  7th  Infantry  IM  vision.  Ihis  battalion  liad  I'oen  trained  in  the 
conduct  of  day  and  night  attack  and  det'onse  and  was  deteirn’ined  to  tie 
proficient  to  level  2 in  those  areas  as  defined  in  ARTFP  7-15.  liie 
performance  of  each  player  was  closely  observed  durinq  ttie  conduct  of 
all  Irials  in  order  to  satisfy  the  pur'iosc  of  the  oxjiorimonl.  Players 
were  critiqued  at  the  conclusion  of  e.'cli  trial  on  tactic.vl  doficioncios 
noted  durinq  t.ho  trial,  it  is  doubtful  that  the  tactical  proficiency 
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of  any  ccrbat  unit  has  I'vor  hoforo  hccn  so  closely  scrutinized  over  such  v 

an  exteruied  noriod  of  fii'e.  llie  platoons  and  squads  providinu  nlayer 
personnel  for  this  exporiii'cnt  were  probably  tiic  tiest  trained  infantry 
units  of  their  size  in  tnc  UG  Arry  when  the  experiirent  was  conclu'^cd. 

5.  Observations  Ccncernino  Trainino. 


a.  The  probability  of  the  attackinn  platoon  leader  beconiinq  a cas- 
ualty during  the  last  200  rotors  of  an  attack  is  sufficiently  tiigh  to 
justify  a special  training  effort  to  insure  that  his  iiTicdiate  successor 
is  well  trained  in  tlie  platoon  leader's  duties  and  t'csnonsibi  I i tics . 

b.  During  the  conduct  of  tlie  attack,  the  .•adio-telephone  operator 
(RTO)  was  much  more  of  an  asset  to  the  attacking  platoon  leader  when  he 
was  well  trained  in  indirect  fire  pixicedures. 

c.  Player  n:overent  was  the  single  r:ost  important  factor  in  reveal- 
ing the  location  of  defensive  positions  to  attacking  platoon  players. 

' d.  The  hand  grenade  became  an  effective  offensive  weapon  only  after 

[ attacking  platoon  players  understood  its  enployii'ent  and  gained  proficiency 

f in  its  use. 


e.  Defensive  players  w!io  failed  to  select  and  cnoage  priority  . 

targets  greatly  reduced  the  overall  effectiveness  of  the  defense.  ^ 

B . CDEC  Experiment  EC__0 Tactical  Effectiveness  of  r-'inefields  in  f 

the  Antiarmor  f'eanons  S''ste!i>  iTLr.Ab’S).  Apr  77.  j 

^ 1.  Purpose.  TEKA'.JS  was  an  armor-infantry  force-on- force  field 

experiment  conducted  to  collect  data  in  a realistic  con'bat  enviornment 
to  evaluate  the  effectiveness  of  scatterahle  antitank  minefields.  The  , 

I results  of  this  experiment  will  be  used  by  the  USAIS  and  CACDA  as  a 

I basis  for  operational  and  production  recommendations  for  scatterable 

i Minefields  in  the  Antiarmor  'w'eapons  System  (TEMAWS). 

2.  Concept.  The  experiment  consisted  of  a scries  of  trials  por- 
traying a qui ck  "attack  by  a simulated  Soviet  reinforced  tank  comoany  j 

against  antitank  elements  of  a mechanized  infantry/ tank  {earn  defendinn 
in  the  main  battle  area.  Laser-cquipned  direct  fire  weapons,  sii’ulated 
scatterable  mines,  indirect  fire  simu'lations , and  continuous  conriunica- 
tion  between  eaci)  weapon  system  and  a coirputer  enabletl  CDEC  to  create 
a realistic  battlefield  envi  ronment  in  which  casualties  wena  assessed 
as  they  occurred.  Side  tests  were  conducted  to  evaluate  detection  of 
mines  at  night,  to  compare  the  effectiveness  of  nioht  vision  devices 
to  assist  detection,  to  observe  the  effects  of  sroke  on  detection,  and 
to  measure  the  effect  of  tank  speed  on  mine  detection  and  avoidance. 
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3.  Posj^n.  Fach  trial  conorated  tv.o-sidod,  roal-tiiro,  tari>^t 
acqiiisi  tion’ and  onoanen-ont  seaiioncos.  Trials  exap'inod  or.ly  tfuU  portion 
of  the  battle  which  tool,  place  within  a 3000-i:'.otor  wide  by  15C0-i:ieter 
deep  portion  of  the  battlefield.  Six  different  player  sets  conducted 
143  record  trials  fror;  Aupust  to  Decen:ber  M76.  duly  daylirlit  record 
trials  \/ere  conducted.  Three  different  terrain  sites  were  used. 


4.  PJayer  Proficiency.  Player  personnel  were  provided  by  tiu' 

2d  P)atlalion  iCkF  .Ar'i.o’r’  O'sl.  Infantry  Pivision),  6th  Battalion  32d  Ari'or 
(4th  Mechanized  Picision),  Pd  Pattalion  33d  Infantry  (7th  Ir.fantry 
Division)  and  otlier  selected  FORSfOM  units.  The  armor  units  were  trained 
at  Fort  Hunter  Linpett  (FHL)  to  etploy  specific  tiireat  t.actics  and  to 
operate  buttoned-up.  Tiie  ,APC  mounted  TO'd  eleircnts  were  piven  weapon 
qualification  trainine  by  CDFC.  The  DRAGOH  ounners  were  piven  weanon 
qualification  trainine  by  the  I'SAIS  at  Fort  Fennino.  Human  factors  data 
weix^  qathered  by  iivm i toriiu;  th.e  nerfomnance  of  the  nlaver  force  during 
all  trials,  and  fromplaper  debriefinqs  and  tactical  critiques  at  ttie 
conclusion  of  each  trial.  By  the  end  of  tf’O  experiment,  t!ie  threat 
armor  players  were  undeubtedlv  the  best  trained  armor  units  in  ttie  t'S 
Ari'-y  at  executine  Put  tuned- ua  opei'O.tiens.  Similarly,  tiie  Tdl.'  and  DilAGO.'t 
aunners  probably  had  more  tactical  training  Uian  rust  otiier  US  Army 
gunners . 

5.  Observati ons  Conce rni no  T rai ni no. 

a.  Tank  crews  requiivd  3-6  weeks  of  trainine  and  practice  to 
become  pixificient  in  cress  country  driving  and  tactical  oi'erations  wiiilo 
buttoned- UP. 


b.  Present  Tan.k  Co":mander  (Tf)  battlesicht  uunner\  teciiniques 
ai'O  too  slew'  wiicn  ,‘'60AI  drivers  and  giainers  acauiiv  targets  wiiile  buttened- 
un. 


c.  The  tank  driver  used  a.  clock  reference  system  to  speed  handetf 
of  targets  to  the  gunner  and  tank  eomr'ander. 


d.  The  plo.v  and  line  ciia 
cessfullv  breach  a sea  t *.  crap',  e r 
antiarmor  weapens  ai'O  s v. ra:.'.cc' 
aiv  caiMfully  reiiearsod  an.i  viv.o 


roe  C.iuntormoasure  (CM)  devices  can  suc- 
inefieid  cmly  if  the  deferse  direct  fire 
, and  It  the  tiasty  breaciiing  preced.ires 

rouslv  executed. 

<( 


c.  Significant  ao'  a'ld  and  central  I'rablems  that  resulted  from 
buttonod-up  operations  and  need  corrective  training  emplwisis  were: 

(1)  Reduced  visibility  and  vientli  nerceptien  threuci  vision  tlocl.s 
altoivd  perspective  or  ; ,e  terrain,  and  rxuie  cc:"'Mnd  and  cenlrol  generally 
iiorc  difficult,  llie  cv'pany  coar\indar  could  seldom  see  roro  than  one 
platoon  at  a tire. 
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(2)  Limited  vision  made  it  difficult  to  iraintain  unit  formations. 

(3)  Total  dependence  on  radio  further  complicated  coinnand  and 
control  because  buttoned-up  coerations  precluded  hand  and  arm  signal-- 
and  limited  other  visual  control  techniques. 

(4)  Volume  of  fire  was  reduced  because  target  detection  was  vet- 
difficult.  Tank  crews  were  reluctant  to  stop  moii'.entarily  and  searclt 
for  targets  while  in  the  minefield. 

f.  In  buttoned-up  operations,  except  for  the  very  liigh  density 
minefields,  terrain  artpeared  to  be  more  significant  than  minefield  oOi.Mty 
in  deteriiiing  tiireat  tank  speed. 

g.  The  f'60Al  driver  is  the  only  crew  member  who  can  effectively 
detect  and  avoid  mines  wnen  tlie  tank  is  buttoned-up. 

h.  Tactical  eirployrent  considerations  should  bo  incorporated 
into  TOW  and  DRAGOd  gunner  training  courses. 

i.  fletcorol  egi  cal  conditions  (Ivaze,  glare,  dust,  shadow)  should 
be  considered  in  selecting  anti  armor  missile  firing  positions. 


j.  Defensive  positions  were  nost  often  revealed  by  firing  and 
movement  signatures. 

k.  Antiarmcr  v.oanons  crews  rust  bo  trained  to  select  and  prioi'i- 
tizo  targets  williin  thei  r assigned  sector. 
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lateral  accelerati ons  to  .la,  at  speeds  u:/  to  58  ii'ph.  Tfie  trackinn 
weapons  systems  (TO'.i's  and  iXOATs)  wore  rotated  between  various  ranpcs 
and  offsets  throuphout  ttie  OAncrimcnt.  Eacti  TOW  and  ’XOAl  was  placed 
on  a prepared  olatforrr  '/ith  a 5-dcgrGO  left  or  right  cant  wnic.h  required 
gunners  to  sinul  tanecus  ly  r'aninulatc  traverse  and  elowation  controls 
while  tracking.  Gunner  nerfon-ance  was  recorded  by  notion  picture  film, 
video  tape,  and/or  analog  strio  criarts. 

PI  aver  Proficiency.  Players/gunners  were  provided  by  An:or 
Company  C,  Exoeri nen tati on  Suiiiort  Ccinnar.d,  CPEC.  I’ost  of  the  players 
had  particioated  in  previous  field  exeerin-entaticn  and  i.orc  very  f,-.niliar 
with  their  respective  weapons  systems.  Every  gunner  attciuled  over  50 
hours  of  pre-experimentation  training  which  consisted  of  refresher 
training  on  basic  gunner  skills  as  well  as  special  training  on  exper'i- 
ment-peculi ar  aimpoints  and  lead  angles.  During  the  conduct  of  trials, 
each  player's  performance  was  closely  observed  and  a debriefing  was 
conducted  prior  to  player  rotation  to  insure  pertinent  gunner  comments 
were  recorded. 

5 . Obsorvatiens  Concerninn  Trainino . 

a.  The  average  IIA  gunner's  ability  to  perceive  correct 

target  COM  showed  no  significant  improveirent  despite  a major  training 
effort  devoted  solely  to  ihat  end. 

b.  Many  M60A1  nunners  exncrienced  difficulty  in  simul tancously 
applying  azimuth  and  elevation  corrections  vihile  tracking  a target 
oxecutitig  serpentine  i”aneuv'ers  at  speeds  of  from  15  to  55  miles  per 
hour. 


c.  Video  Threugh-the-Si gilt  (TTS)  Closed  Circuit  Television  (CCTV) 
recording  systems  provided  an  excellent  moans  of  training  and  evaluating 
M60A1  gunners. 

d.  The  CDEC-developod  system  for  generating  M60A1  trackinn  error 
data  is  an  efficient  means  of  recording  and  evaluating  tank  gunner 
tracking  performance. 

G.  The  task  load  for  an  M60A1  gunner  who  must  apply  lead  to  hit 
a moving  target  was  so  excessive  in  HIM.AG  IIA  trial  conditions  that  a 
target  hit  was  highly  improbable. 

D-  CPEC  Experiment  EC  Qj6,__T cst  of  flew  and  Improved  Maps  and  Map 
Products  - Phase  111  (’’APPRO  Ilf),  Jul  77. 

1.  Pu rnpse.  The  nuiTose  of  Phase  III  of  the  Test  of  Mew  and 
Inprovod  Maps  and  Map  Products  (MAPPRO  III)  was  to  evaluate  the  relative 
utility  of  four  man  products  v.iien  used  by  armor  personnel  for  identifica- 
tion of  specified  Military  Geographic  Information  (MGI),  for  day  and 
night  cross-country  navigation,  and  for  remote  target  location. 
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i’.  li'iuri't.  r'Ai’I'I'O  III  i.M',  A thri'i'  |Mi(  I'xpi'i'i  MK'M  1 (.'oir.i  I t niij 
oC  c ('t\u  t u .1 ! c (I’.ut  1).  i t iv  it.H'i  o.i  t um 

iitui  tvifpi't  IxH.itiOn  Jui'iih'  J.iyhi'iil  (I’.irt  . .iiul  innht  (I’.ift  A).  Hu' 
lOiu'i'i't  tC'f  riia'ii'  111  (■  lia  , I .-I'd  tPO  tiiiicticinal  nnlitaty  uso'’.  of  a iiMp 
in  I onjuni't  ion  vith  nonal  s up;' lomon  fa  1 aiil'-. 

d.  IV'siijn. 

a.  I’art  1 wa'.  il>“.  i 'inod  to  ovaluato  tho  ivadal'i  1 i tv  of  Hi  litany 
(loi'iinaphi  t a 1 1 n loni:  a t i ('ii  ^Mtll)  iiMtini".  as  clop  i i.  t I'd  I'o  oa.cli  ira;'  pcocluct. 
lisinu  t!io  ntao  poi'cltu  I , plavc’os  c.cm'c'  ic'ciun'ocl  to  ilc'sofi c'c'  and  answoi' 
cjuc'stions  c'c'iioonn i no  ;'fc''.c'l('ctod  Mill. 

h.  I’art  ? was  di'sicuii'd  to  ovaluato  tho  rc'lativo  utility  of  four 
diffori'nt  iis'p  prc'diu  ts  I'n  r('iitc'  plannint],  n.i v i cm t lon.i  1 aocuraov,  and 
taruot  location  durinu  davlioht.  iho  navi  oat  i ona  1 aoouracv  of  plavc'rs 
was  c'valuatc'd  orirMrily  on  tho  ha'-is  of  nlavi'r  sc' 1 1 - 1 c'O.'t  i on  wln'ii  n.u'i- 
ualino  I'c'Ii.ooo  prc'sc'nhc  c!  clic'ol.po  i n ! ■. . ftsis  urcvani  t s \;cmc'  ot'tainod  hv 
ooniparinu  llu'  niavc'r's  i"-!  irate'  cil  lii'>  locaticin  t c'  actual  location  in 
the'  vicinity  ot  chc'cLpoi  i;  t s . I'c'a-.  uroiron  ts  of  tariii't  location  ac  c uraev 

wc'i'o  ohtaiiu'd  hv  ci'iri'a.ri  no  the'  playe'r's  ostiiaatc'd  loc'ation  c't  ttio  tareU't 
with  the'  tai'iiot's  true'  le'eation. 

c.  I'art  3 was  dc'aie'iu'd  to  ovaluato  tho  rolativo  utility  ot  tlio 
four  ciittore'iit  map  pre'duct'.  on  iiav  i oa  t iona  I aocuraov  eilc'iiei  spocifiod 
route's  and  taren't  locatie'ii  duriiM  darknoss.  l\".icin  c't  I'art  3 was 
ossontially  the'  sairo  as  that  ol  I’art  2. 

4.  I’layor  I’re'f  i e i o'u\ . Ihc'  3h  players  ('art  i vi  pa  t i no  in  I’art  I 
wc'tv  Junieir  c'ltuors  ^.'l  is)  e'l  wirtc'us  t'raiuhe". , and  inid-orado  I'lt'Os 
with  infantrv  viiul  i oc'c'iina i ssance'  He'S's.  Iwe'lvc'  armor  c'tticc’rs  and  13 
armor  N'l'th-  we'ic'  sc'li'ctc'd  t re'in  the'  orioinal  3t'>  pl.ive'rs  te'  participate'  in 
I’arts  2 and  3.  I'rior  to  Part  1,  all  I'l.iyor'-  ('art  i cipate'd  in  a clas'.roe'ia 
li'ainiiie)  I'roeiram  wh  i e h e'S'i'lias  i .•e'd  t ami  1 i ar  i Cei  t i e'li  with  the'  v.irioei'.  map 
products  and  to  re'vie'w  hasie-  mai'  re'aelitui  skills.  Ihe'  eioal  was  te'  hrino 
all  I'leiyors  to  re'asoiKih  1 \ e'e]ua,l  le'Ve'ls  ot  I .uni  1 i ari  t}' . ce'iitidonco  and 
ability  with  oacli  of  tho  map  ('roducts. 

5.  Obsi'rvat  i ons  toiie'e'rn  i ip;  1 r.iiiiinej. 

a.  Althouoti  thore'  \,'as  hi>;h  ('ositivo  eorre'lation  he'twoon  tho 
writte'ii  I'lv  .ind  I'e'st  tr.iiniipi  ti".ls  .iiul  a ('O'.itivo  eorre'lation  tie' t'..’i'e'n 
day  and  nii'ht  n.iviiMtion  error'.,  the'ie'  w.is  no  corre'l  .it  i on  he'tv.e'e'ii  the' 
pi'f fe'rii'.iiie'e'  e't'  ,111  1 lid  1 V 1 du.i  1 i'll  writte'ii  tosts  and  that  individuars 
(lorformanco  in  t iold  navi  ii.it  ion. 

b.  Trainiiio  sliould  or'phasico  tho  uiiO  ot  all  map  ivadiiiei  toctiiiiijuos 
and  navioational  aid',. 

c.  Odome'lor  ro.ulinps  must  bo  supple'iiviitod  for  accurate'  cross- 
ii'untry  navi  oat  ion. 
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il.  PiffiMVtit  rv.i'  tv.iJiiu'  trainino  protitMins  aro  Pfohal'ly  n'd 

to  [irinp  junior  orado  ottiror;-  and  flCO's  to  the  saiiio  lovol  of  ovorall 
exportibo. 

0.  Iraininq  shouU!  oivdiasizo  tlio  uso  of  rcliof. 

f.  I’oriodic  rofro'.hor  traininy  in  tarcjot  location  technique  is 

needl'd. 

VI.  SlifTAKV 

IKAIHK  is  eurrt'ntlv  involved  in  nuinorous  proorams  desiciiu'il  to  identify  and 
evenluallv  rednct'  the  loss  in  unit  proticienev  due  to  inadequate  or  inappro- 
priate traininq  - the  "Irainino  tlaii"  (some  exairiiles:  WSllAs;  CllAs;  AItttPs; 
eneaoeir.i'n  t >■.  iinu  1 .1 1 i on  ; the  rJ.it  ional  Iraininq  Centers  and  the  Army  Irainino 
System  SliuK).  Most  or  ,1 1 1 ot  those  studies  will  reeiiiiv  hoth  qualitative 
aiui  (luan  t i t a t i ve  traininq  data  to  supiiort  (hem.  Since  tiu'  collection  of 
quan  1 1 t a ( i \i'  trainine  d.-t,.,  in  such  a broad  sense,  is  a ne'v  requi  reuvnt , 
Iraininq  Measure  ot  1 1 ii'c  ti  veness  imist  often  in'  dt'veloped  as  the  need 
arises.  Unlike  tlu'  ci'iiil'at  do  ve  1 ooiren  t area,  tliere  are  tew  "proven"  (rain- 
inq  Mdfs.  Ciinsequen t 1 \ , tnere  is  a neevi  for  lliose  in  (he  (rainino  eoma'unUy 
to  coordinate  tlu'i  r et  forts  and  document  tlieir  results.  Ihis  documi'iitation 
is  lu'i'di'd  in  order  to  ('sta.l'lish  a list  of  "reliable"  (rainino  MOfs  that  can 
be  employed  aiu!  refined  1-v  otlw'r  usi'rs.  Since  now  traininq  svsteii'S,  tecli- 
niqui's  and  equipment  i-ill  I'o  di'volooi'd,  floxil'ilitv  in  the  choice  ot  a 
traininq  MCi.  must  still  be  maintained.  In  addition,  the  (yne  ot  unit 
(coiabat  versus  combat  sirmort),  sice  of  unit  (squad  vorsus  t'attalionl,  and 
tvpi'  ot  trainin'’  (individual  versus  collective)  will  often  require  di'terent 
M'[.s.  Ihesi'  prel'li'ics  turtlier  increase  the  need  tor  thi'  traminu  eommiinity 
to  share  infenratien  on  tne  develonment  of  Irainino  f\''[s.  An  exam’ple  ot 
one  such  eoordinated  eiierf  is  depicted  on  the  tollowinq  diaoram: 


MAllOhAL  IKAININC.  Cl  Mil  KS 


Aitii  r n;  V!  1 M c — — > iachcai  [NCAcinrii 

AMI)  Id  I IM  Ml  :;i  SlMUl  A1  lO'M 


In  v'rder  to  ili'velo!'  traininq  f'di  s j or  use  in  two-sided,  i ns  t rurx'n  ti'd 
enqaaec  e'lt  swulatien  ev"-r;  ents,  CC.  t has  heen  lowk  1 no  wi  t (1  represen- 
tative'. t tv " !'',M  (SatiMi'i  I'Minini;  Ci'nter),  CAllMil'A  (Matienal  Iraminq 
Center),  l',"-iiS  (lact'n.l  lr';a(’ement  Sii'ulatien  and  '101!'  Pe\e  loj'PX'nt  ) , 

(he  Servue  t-alieols  i\",e  1 epi  on  t ) aiul  AK!  tAPliP  I'ece  1 epi'en  t ) . 

In  return,  Cf;  C has  nro'.ided  ('av.'i  ot  these  aeetutes  witfi  traininq  aiul/er 
1 ns  t rim'i'n  t a.  1 1 on  1 r.  t et  ■ .i  t ; . n i\  " prior  test',  and  plans  (0  loordinate  th.e 
ci'llt'ctien  (>;  future  ir.iininq  d.ita  witli  t (lem  a',  i.i'll.  Ihis  sharinq  ot 
in  ti'rmat  W'li  ha-,  hren  rut.;,;lh  I'onetui.il  a.nd  should  he  encouraqed  elsewheix' 
in  I lie  t rainiii'i  c ('l•■.;'uni  t , . 


7HA 


APPCNDIX  A 


ACRQNY^^S 


API 

ARTEP 

ATKT 

CAC 

CACDA 

CAT RADA 

CDC 

CDEC 

COM 

CTEA 

DOC 

DRAGON-TEA 

EEA 

HI HAG  IIA 
HONEST  I 

IPR 

ITV 

MAPPRO  III 

MECH  ARTEP 

MILES 

HOE 

NTC 

PARFOX  VII 


Army  Research  Institute 
Army  Training  and  Evaluation  Program 
Antitank  Missile  Test 
Combined  Arms  Center 

Combined  Arms  Concept  Developn:ent  Activity 
Combined  Arms  Training  Development  Activity 
Combat  Dove  iopn'onts  Command 
Combat  Developments  Experimentation  Command 
Center  of  Mass 

Cost  and  Training  Effectiveness  Analysis 
Defense  Documentation  Center 

DRAGON-Training  Effectiveness  Analysis  Experiment 
Essential  Elements  of  Analysis 
High  Mobility/Agility,  Part  IIA 

Helicopter  Operations  in  a Night  Environment  Against 
a Simulated  Threat,  Phase  I 
In  Progress  Review 
Improved  TOW  Vehicle 

Test  of  New  and  Improved  Maps  and  Map  Products,  Phase  III 

Mechanized  ARTEP  Experiment 

Multiple  Integrated  Laser  Eneagcn>ent  System 

Measures  of  Effectiveness 

National  Training  Centers 

Evaluation  of  the  Frontal  Parapet  Foxhole,  Part  7 


TAHOE 

TAMI 

TCATA 

TDWG  for 

ATES-FYTP 

TEA 

TE  MAVIS 

TETAM 

TSM-TES 

WSTEA 


TOW  Against  Helicopter  Operation  Exnorin’ont 

Tank  and  Mechanized  Infantry  Experiment 

TR/\DOC  Combined  Arms  Test  Activity 

Training  Pevelopment  Working  Group  for  Armv  Tactical 

Engagement  Simulation  Five-Year  Test  Program 

Training  Effccti veness  Analysis 

Tactical  Effccti  veness  of  Minefields  in  tlic  Anti-An::or 
Weapons  System 

Tactical  Ef fecti veness  Testing  of  Anti-Tank  Missiles 
TRAPOC  System  Manaoer  - Tactical  Encaccr'ont  Siirulation 
Weapon  Systems  Training  Effectiveness  Analysis 
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APPr.NUIX  1; 


The  Tank  and  Pcchanizcd  Infantry  Test  was  fonrorly  scticcluled  for  execution 
during  Octobcr-necei"bor  of  tin's  year.  The  purpose  of  TAP!  was  to  inves- 
tigate current  daylinht  offensive  doctrine  and  tactics  for  Oefoatinn  a 
Soviet  motorized  rifle  unit  in  a hasty  defense.  Tins  was  a tv.o-siced, 
forcc-on- force  field  experiment  tliat  matciicd  a US  tan!.  Iieavy  coimanv  team 
in  the  laovcu'cnt  to  contact  anainst  a reinforced  i-otoinzed  rifle  comrany 
in  a hasty  defense.  Althoupii  the  test  proponent  was  lACI’A,  US.AIS  ainl 
USAARPS,  API,  TSP-TPS,  CATR.APA  and  L'CST  were  very  much  invoUed  in  tiie 
design  of  the  experiment.  Specific  ol)jectives  of  this  Lest  were; 

ODJtCTIVP  1:  To  gain  insiglit  into  tnc  dynamics  of  the 

tank  and  mechanized  infantry  company  team 
conducting  offensive  opcratioiis. 

OBJCCTIVE  2:  To  obtain  information  to  compare  tlie 

relative  effectiveness  of  arn'or  heavy 
company  teams  eirployincj  various  offen- 
sive tactics  against  a threat  motorized 
ri  flc  uni t. 


OBJECTIVE  3: 


OBJECTIVE  4: 


OBJECTIVE  5: 


OBJECTIVE  6: 


To  pi'ovide  informatic)n  to  verify  and/or 
provide  recommended  chanoes  to  current 
field  iiianuals  and  training  circulars. 

To  obtain  information  to  investioate 

the  effect  of  tlireat  electronic  warfare  on 

a US  lank/mecliani zed  infantry  coiapany  team. 

To  obtain  data  for  use  in  tank  and  mech- 
anized infantry  play  in  liigh  resolution 
combat  models. 

To  (X'ovide  inforiiMtion  whicli  can  be  used 
to  investigate  selected  aspects  of  tank 
and  n:oclianizcd  infantry  trainino  programs. 
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~ITI.E:  Formative  Utilization  of  a Model  for  the  Prediction  of  the 

Effectiveness  of  Training  Devices 

UJTHOR;  Dr.  Marshall  A.  Narva 

U.  S.  Array  Research  Institute  for  Behavioral  and  Social  Sciences 

ABSTRACT:  A model,  which  provides  a framework  for  the  application  of 
judgmental  data,  has  been  under  development  for  use  in  the  prediction  of 
the  training  effectiveness  of  training  devices  in  the  conceptual  stage  of 
development.  During  the  utilization  of  the  model  for  the  assessment  of 
two  existing  maintenance  trainers,  various  aspects  were  uncovered  which 
suggested  a need  for  changes  to  enhance  the  practicality  of  its  applica- 
tion. The  revised  model  is  presented  with  a discussion  of  the  rationale 
for  the  changes.  The  model  utilizes  a task  analysis  of  the  operational 
situation  to  isolate  the  skills  involved  in  the  training  objective. 
Judgments  are  then  made  concerning  the  coverage  of  the  required  skills, 
and  the  physical  and  functional  characteristics  of  the  device  used  for 
training  in  the  required  skills,  in  order  to  obtain  an  estimate  of 
predicted  training  effectiveness. 
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Formative  Utilization  of  a Model  for  the  Prediction  of  the  Effectiveness 

of  Training  Devices 

Dr.  Marshall  A.  Narva^ 

U.  S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 


■As  a consequence  of  increasing  budgetary  and  environmental 
restrictions  associated  with  tlie  conduct  of  military  operations  for 
training  purposes  there  has  developed  an  increased  interest  in  the 
utilization  of  training  devices,  in  lieu  of  or  in  conjunction  with  such 
operations.  However,  the  development  of  the  devices  themselves  may  well 
entail  the  investment  of  substantial  resources.  Therefore,  a need 
exists  for  a methodology  for  the  systematic  assessment  of  the  character- 
istics of  training  devices  under  development.  If  sucli  a methodology 
could  be  developed  which  would  permit  making  valid  predictions  or  recom- 
mendations concerning  the  selection  or  design  of  device  concepts  or 
prototypes,  resources  could  be  directed  into  the  development  of  devices 
having  the  lilgliest  probability  of  leading  to  the  best  training  results. 

An  auspicious  attempt  at  such  a model,  called  TRATNVICE,  has  been 
developed  for  the  Army  Research  Institute  (Wlieaton,  et  al.,  1976,  a,  b, 
c).  This  model  is  based  on  an  extensive  review  of  the  literature  and  is 
tile  result  of  analytical  work  by  a team  of  experienced  behavioral  sci- 
entists. This  paper  will  outline  the  original  TRAINVICE  model,  its 
applications,  and  present  suggestions  and  rationale  for  a revised  model 
based  upon  a fornuitive  utilization  of  TRAINVICE.  The  revision  was 
undertaken  with  a view  to  enhancing  the  validity  and  practicality  of 
application  of  the  original  model,  based  upon  experience  gained  in  its 
utilization.  Further,  the  suggested  revision  aims  to  make  the  methodology 
more  amenable  to  utilization  by  a wider  spectrum  of  users. 

The  TRAINVICE  Model 


It  would  be  well  to  review  the  TRAINVICE  model  at  this  time  as  it 
served  as  the  foundation  for  the  development  of  the  revised  model  which 
will  be  discussed  subsequently.  A schematic  representation  of  the 
TRAINVICE  model  is  presented  in  Figure  1.  This  model  is  based  on  the 
assumption  that  certain  attributes  to  be  assessed  in  the  training  sit- 
uation will  lead  to  transfer  of  training  to  the  operational  situation. 
Therefore,  the  higher  the  rating  on  the  assessment  factors,  the  higher 
the  transfer  that  will  take  place  and  the  more  effective  the  device. 

The  model  provides  a framework  for  the  making  of  tliese  Judgments  con- 
cerning these  attributes  and  combines  the  results  of  the  judgments.  The 
three  variables  entering  into  tlu'  assessment  are  (11  the  transfer  poten- 
tial of  the  device,  (2)  the  learning  deficit  to  be  overcome  and  (T) 
instructional  effectiveness.  As  with  any  model,  its  effectiveness 
depends  on  the  adequacy  of  the  input  data.  Inputs  into  the  model  con- 
sist of  descriptions  of  the  tasks  and  subtasks  represented  in  the 

^Tlie  opinions  expressed  in  this  paper  are  not  necessarily  those  of  the 
Department  of  the  Army. 
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miMING  03JCCTIVC 


(From  '.Wheaton,  et  al,  197C  b) 


operational  situation,  as  circumscribed  by  the  training  objective,  and 
those  represented  in  the  training  device.  The  controls  and  displays  and 
their  functions  for  both  situations  are  listed.  In  addition  the  skills 
and  knowledge  involved  in  each  subtask  in  the  operational  situation  are 
formulated  for  use  in  the  model.  Using  these  inputs,  judgments  are  nude 
using  the  rating  scales  given  in  Figure  2.  The  subtasks  in  tlie  two 
situations,  operational  and  training,  are  compared  to  ascertain  if  pro- 
vision is  made  for  representation  of  the  subtasks  in  the  training  device, 
in  the  communality  analysis.  Next,  the  displays  and  the  controls  for 
both  situations  are  compared,  on  physical  and  functional  similaiity.  As 
may  be  seen  from  the  rating  scales,  the  more  similar  the  display  or  con- 
trol in  the  training  device  is  to  the  operational  situation,  the  higher 
the  score.  This  is  based  on  the  premise  that  the  greater  the  physical 
or  functional  similarity,  the  greater  the  transfer  of  training  that  will 
result.  Pltysical  similarity  refers  to  the  appearance  and  physical 
aspects  of  the  displays  and  controls  involved;  i.e.,  their  "fidelity"; 
functional  similarity  refers  to  the  amount  of  information  conveyed  by 
the  display  or  involved  in  the  operation  of  a control,  in  information 
processing  terms.  The  learning  deficit  analysis  is  based  upon  (1)  the 
assessment  of  the  level  of  proficiency  in  eacli  skill  or  knowledge  for 
the  students  upon  entering  the  training  situation,  (2)  tlie  desired  level 
of  proficiency  in  each  skill  or  knowledge  for  tlie  students  upon  leaving 
the  training  situation,  and  (3)  the  difficulty  tin  terms  of  training 
time)  of  training  in  the  skills  or  knowledges  involved  in  a subtask. 

[ This  analysis  yields  a weighted  learning  deficit  for  each  subtask.  I'he 

judgments  concerning  the  level  of  each  skill  or  knowledge  are  made  using 
the  scales  shown  in  Figure  2,  adapted  from  Demaree  (Idbl).  The  last 
analysis  involved  in  the  TR^MNVICE  model  is  an  assessment  of  how  well 
the  training  device  adheres  to  "good"  training  techniques.  In  order  to 
perform  this  analysis,  each  of  the  subtasks  is  cast  into  one  or  more 
categories  of  behavior.  As  given  in  Figure  2,  these  categories  are 
those  of  Braby  et  al  (1972),  which  are  derived  from  an  earlier  behavioral 
categorization  by  Willis  and  Peterson  (1961).  For  each  of  tlie  behavioral 
categories  represented  in  the  subtask,  a list  of  guidelines,  also  those 
of  Braby  et  al  (1972),  are  consulted  and  judgments  made,  using  the  scale 
shown  in  Figure  2,  of  the  degree  to  which  the  guidelines  are  followed, 
or  not  followed,  relative  to  the  manner  in  which  the  subtask  is  repre- 
sented in  the  training  device.  The  guidelines  are  broken  up  into  those 
dealing  with  the  stimulus,  response,  and  feedback  aspects  of  the  training 
situation.  For  each  subtask,  the  lowest  obtained  score  on  eacli  of  the 
three  aspects  is  used  to  derive  an  average  training  teclinique  score. 

All  of  the  preceding  ratings,  after  conversion  to  yield  a score  ranging 
from  0 to  1,  are  then  fed  into  an  equation  to  formulate  an  index  of 
prediction  of  training  effectiveness,  ranging  from  0 to  1.  This  equation 
is  as  follows: 

KCi  X Si  X Ti  X Di) 

Fin 


where  C is  task  communality,  S s imi  1 i.ar ity , T training  techniques,  and  11 
the  training  deficit  scores  for  each  subtask.  Tlie  equation  was  derived 
from  a transfer  of  training  equation  of  Gagne,  Foster  and  Crowley  (1943). 
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ooi-u-iuNALiTY  PHYSICAL  SIMIIJ^RITY  FUNCTIONAL  SIMILARITY 
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which  was  for  use  with  empirical  data,  while  tlie  TRiMNVU'E  extrapolation 
deals  with  judgments  made  concerning  aspects  of  a device  assumed  to 
bring  about  subsequent  transfer  of  training. 


A validation  study  lias  been  performed  on  tlie  model,  utilly.ing  data 
obtained  during  the  course  of  two  field  studies  as  criteria  against 
which  to  compare  the  predictions  derived  from  use  of  the  model  (Wlieaton, 
et  al.,  1976).  The  devices  were  t.ank  gunnery  trainers  involved  with 
burst-on-target  techniques  and  tracking  with  the  main  gun  of  the  M60A1 
tank.  In  each  case,  the  prediction  of  no  differences  between  the  train- 
ing devices  involved  was  found  to  be  consistent  witli  the  equivalence  in 
transfer  actually  found  in  utilization  of  the  various  devices.  This  was 
felt  to  be  a promising  but  not  definitive  finding. 


In  order  to  obtain  additional  validation  data  on  the  model,  but 
also  to  obtain  experience  in  utilization  of  the  model  to  determine  if 
there  were  aspects  that  miglit  be  changed  in  order  to  enhance  the  prac- 
ticality of  utilization  of  the  model,  three  Army  Research  Institute 
personnel  applied  the  model  to  two  maintenance  trainers  undergoing 
evaluation  at  the  Army  Ordnance  Center  and  School.^  This  afforded  the 
opportunity  to  obtain  data  within  a different  context  than  that  dealt 
with  by  gunnery  trainers.  These  trainers  were  concerned  with  automotive 
troubleshooting.  No  difference  in  training  effectiveness  was  predicted 
for  the  two  trainers,  wliich  agreed  with  tlie  results  of  the  empirical 
evaluation.  Various  aspects  of  the  model  wliich  caused  difficulty  in  its 
utilization  were  noted  and  influenced  the  development  of  tlie  modified 
version.  In  .addition,  ARI  conducted  a three-day  workshop,  in  which  the 
developers  of  the  original  model  and  individuals  who  had  utilized  the 
model  or  had  an  interest  in  its  utilization  participated,  and  this 
furnished  further  ideas  for  possible  modification.- 


The  Revised  ^ode 1 

A schematic  representation  of  the  main  components  of  the  revised 
model  is  given  in  Figure  1.^ 

Basically,  the  model  considers  three  m.iin  aspects  of  the  training 
device  during  the  course  of  the  assessment;  what,  why,  and  how.  "RTiat " 
involves  an  analysis  of  what  skills  (or  knowledge!  should  be  covered  in 
the  tr.iining  situation  and  what  skills  are  covered,  in  order  to  .iscer- 
t.iin  that  the  spectrum  of  skills  covered  neither  exceeds  that  which  is 
necessary  nor  leaves  out  any  that  should  be  covered.  It  determines  that 
the  skills  covereil  are  in  keeping  with  the  training  objective.  The 
"why"  refers  to  that  aspect  which  determines  why  these  skills  should  be 

^An  ARI  report  summarizing  this  utilization  of  the  model  is  in  preparation. 


"The  revised  model  does  not  necessarily  reflect  the  views  of  the 
participants  in  the  workshop.  Troceedings  of  the  workshop  are  in 
preparat  ion  .is  an  ARI  report  . 

^The  author  would  like  to  express  special  appreciation  fiir  the  technical 
review  and  inputs  provided  by  Ms  Barbara  Mroczkowski,  i'RADOC./TSC. 
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covered,  apart  from  their  being  included  within  the  specirun  el  skills 
subsumed  under  tlie  training  objective.  ibis  consist.s  of  tv%'o  main 
aspects;  training  criticality,  whicli  relates  to  the  degree  of  profi- 
ciency required  in  each  skill  at  the  end  of  the  training,  and  training 
difficulty,  which  considers  the  degree  of  difficultv  to  be  expected  in 
training  for  each  skill.  These  two  analyses,  in  essence,  give  a weight 
to  each  skill.  The  last  main  analysis,  refers  to  the  "how"  of  tlic 
training  device;  tliat  is,  how  is  eacit  skill  t.iught,  .ind  compares  ilie 
training  situation  to  guidelines  of  "good"  practice.  nu’se  guidelines 
are  applied  to  two  aspects  of  the  training  device;  tl\e  physical  and  the 
f unct ional . 

As  with  the  TRfMNVICE  model,  the  assumption  is  being  made  tliat  the 
potential  for  transfer  of  training  will  increase  as  a function  of  the 
degree  to  witich  the  skills  are  represented,  witliin  the  constraints  of 
tile  training  objective,  and  the  degree  to  which  the  training  situation 
follows  guidelines  for  "good"  practice.  In  addition  each  of  the  skills 
is  appropriately  weighted  by  degree  of  skill  needed  and  degree  of  diffi- 
culty . 

Input  data  requirements.  Ilie  first  requirement  is  ll\e  statement  of 
the  training  objective.  As  presented  in  TRADOf.  Reg  .150-100,  Systems 
Engineering  of  Training  (1973),  or  in  the  Interservice  Procedures  for 
Instructional  Systems  Development  (1975),  the  training  objective  states 
the  action,  or  task,  that  the  student  should  be  capable  of  performing, 
and  the  conditions  and  standards  of  performance  he  is  to  attain  as  a 
result  of  the  training.  T)ie  training  objective  carves  out  a piece  of 
the  operational  situation  that  is  to  be  subjected  to  training  and  deter- 
mines to  what  level  this  segment  is  to  be  trained,  whicii  nuy  vary  wiiti 
relationship  to  the  level  actually  required  in  the  operational  situation. 
This  training  objective  may  vary  as  to  level  of  specificity,  with  the 
subsumed  task  and  associated  subtasks  also  varying  as  to  specificity. 

It  should  be  kept  in  mind  that  tlie  procedures  given  in  such  publications 
as  TRADOC  Reg  350-100-1  or  TRADOC  Pam  350-30  (ISD  model)  deal  witlt  the 
derivation  of  a program  of  instruction,  of  which  a training  device  may 
be  one  small  segment.  The  training  device  may  be  considered  to  be  but 
one  of  many  possible  media  or  instructional  delivery  systems.  Therefore, 
the  procedures  must  be  utilized  at  a level  of  specificity  suitable  for 
the  assessment  of  a training  device.  Guidance  to  the  conduct  of  a task 
analysis  are  given  in  such  publications  as  those  above  and  those  of 
R.  Miller  (1953a),  Rankin  (1975)  and  Chenzoff  and  Folley  (1965).  However, 
no  amount  of  guidance  can  substitute  for  the  good  judgment  of  the  analyst 
in  formulating  meaningful  segments  of  activity.  Information  must  be 
derived  concerning  the  task,  component  .subtasks,  required  skills  and 
knowledge,  and  tlie  cues  and  responses  involved  in  tlic  execution  of  eacli 
of  the  skills,  for  both  tlie  operational  and  the  training  situations. 
Therefore,  the  same  input  requirements  exist  as  for  the  original  TRyMMVICE 
model,  with  the  additional  requirement  for  the  definition  of  .skills  and 
knowledge  being  exercised  In  the  training  situation.  In  TR/MNIMGE,  it 
may  be  recalled,  the  subtasks  are  broken  out  for  both  the  operational 
and  the  training  situations,  but  tiie  skills  and  knowledges  are  broken 
out  only  for  the  operational  situation,  in  conjunction  with  tlie  derivation 
of  the  learning  deficit  for  each  of  the  skills.  This  was  concerned  only 
with  tlie  characteristics  of  the  student  and  did  not  consider  what  Is 


ot  foil'd  i)v  ilio  dovioo  ilsolt.  In  iho  n-visod  iiiodoJ  , llic  unit  ol  concorn 
is  at  tho  sk i 1 1 s/know lodgo  lovol  rathor  than  t ho  subtask,  alLhough  those 
two  units  ol  aotivity  can  bo  vory  slniilai.  i'ho  raliunalo  for  going  with 
skills  and  knowlodgos  as  tho  unit  of  conci'in  is  based  on  tlie  assumption 
tliat  tlio  priiik'  objootivo  of  a training  dovioo  is  to  provide  for  tho 
vioqu  is  i t ion  .ind  praot  ioo  of  t lioso  skills  and  knowlodgo  required  to  oarry 
out  tho  task  subsumoil  in  t lio  training  obji'olivo. 

Within  oaoli  skill  or  knowlodgo,  tho  ouo(s)  and  response(s)  involved 
are  to  bo  oxtraoLod  rathor  than  tho  displays  and  controls,  as  in  the 
IRAINVU'K  model,  to  provide  for  greater  flexibility  in  applying  the 
mode  1 . 


Since  the  same  skills  or  knowledge  may  occur  over  tho  course  of 
more  than  one  subtask,  the  skills  and  knowledges  for  the  operational 
situation  are  consolidated  into  one  list  in  order  to  avoid  duplication, 
rhe  same  is  done  for  tho  skills  and  knowledges  from  the  training  situ- 
a t i on . 


tip  VO  rage  roq^uirementsyina^’t^^.  I'he  first  analysis  to  bo  performed 
is  that  concerned  with  the  requirement  for  training  for  eai'i  of  the 
skills  subsumed  under  the  training  objective,  from  the  point  of  view  of 
the  operational  situation.  The  judgment  is  made  for  e.ich  skill  (or 
knowledge)  as  to  whether  it  should  be  included  or  not  be  included  in  the 
training  situation.  Depending  upon  the  complexity  of  the  training 
objective,  this  judgment  may  or  may  not  be  straightforward.  With  a 
fairly  constrained  or  simple  training  objective  or  task,  most  of  the 
skills  may  be  readily  judged  to  be  necessary  for  the  training  situation. 
In  some  cases,  it  may  be  necessary  to  postpone  this  analysis  until  the 
subsequent  analyses  dealing  witli  training  criticality  and  training 
difficulty  have  been  made;  in  some  cases  judgment  concerning  training 
coverage  requirement  may  be  modified  as  a result  of  the  subsequent 
criticality  and  difficulty  judgments.  It  should  be  noted  that  this 
analysis  does  not  deal  with  the  mission  criticality  of  the  subtask,  it 
is  assumed  that  all  the  subtasks  are  necessary  to  mission  success,  but 
rather  witli  the  necessity  for  providing  training  for  the  skills  subsumed 
witliin  each  subtask.  This  analysis  is  a "gate”  only;  it  determines  if 
the  skill  should  be  represented  in  the  training.  Depending  upon  the 
stage  of  development  of  tlie  training  device,  tliis  analysis  may  help  to 
delineate  the  range  of  skills  to  be  represented  in  a device  as  well  as 
assessing  the  range  of  skills  represented  in  a device.  It  may  also  help 
to  define  or  modify  the  training  objective,  if  the  stage  of  development 
of  the  training  program  permits.  If  the  skill  is  judged  to  require  its 
presence  in  the  training  situation,  it  is  given  a "1";  if  not  it  is 
given  a "0".  If,  due  to  tlie  stage  of  development,  this  analysis  is  not 
considered  necessary,  all  skills  would  be  rated  "1."  It  should  be  noted 
that  this  judgment  is  similar  to  that  made  during  the  course  of  the 
learning  deficit  analysis  in  the  TlhMNVICK  model.  In  assessing  the 
level  of  the  skill  required  at  the  close  of  training,  provision  was  made 
for  a "0"  rating,  which  indicated  that  no  training  was  required  in  the 
skill  under  consideration;  it  was  the  low  end  of  tlie  scale.  This  type 
of  judgment  has  been  broken  out  into  this  separate  coverage  requirement 


analysis  i"  the  revised  model  to  permit  a more  complete  assessment  of 
the  range  of  skills  In  the  training  situation. 


Coverage  Analysis.  In  conjunction  with  the  Coverage  Requirement 
analysis,  a Coverage  Analysis  is  also  performed.  Comparing  the  opera- 
tional and  training  lists  of  skills,  an  assessment  is  also  made  for  each 
skill  in  the  operational  situation  as  to  whether  it  is  represented  in 
the  training  situation.  If  it  is,  it  is  given  a rating  of  "1,"  if  it  is 
no,  it  is  given  a "0."  This  analysis  is  the  same  as  the  Communality 
analysis  performed  in  the  TRAINVICE  model.  As  in  TRAINVICE,  both  actual 
and  potential  coverage  may  be  determined  depending  upon  how  the  device 
is  utilized.  However,  this  analysis  is  made  concerning  skills  rather 
than  subtasks,  and  the  list  of  operational  skills  has  been  "adjusted"  by 
the  coverage  requirement  analysis  performed  previously. 

If  the  coverage  requirement  rating  is  "1"  and  the  coverage  rating 
is  "0,"  this  indicates  that  training  in  this  skill  is  lacking  and  steps 
should  be  taken  to  include  it,  if  possible,  or  the  device  will  suffer  in 
the  overall  rating.  On  the  other  hand,  if  the  coverage  requirement 
rating  is  "0"  and  the  coverage  rating  is  "1,"  this  would  Indicate  that 
unnecessary  training  is  being  provided  and  should  be  eliminated  from  the 
device,  if  possible,  or  the  overall  rating  of  the  device  will  suffer. 

If  a "0"  rating  is  given  for  a skill  either  in  the  Coverage  Requirement 
or  Coverage  Analysis,  no  further  analysis  for  that  skill  need  be  done  as 
the  overall  rating  for  that  skill  reduces  to  "0"  due  to  the  multiplicative 
nature  of  the  derived  index. 

Training  Criticality  Analysis.  For  each  of  the  skills  that  have 
earned  a "1"  rating  on  both  the  Coverage  Requirement  and  the  Coverage 
Analyses;  that  is,  for  those  skills  that  have  been  judged  to  be  necessary 
in  the  training  situation  and  are  indeed  represented,  a judgment  is  made 
as  to  the  degree  of  proficiency  required  in  that  skill  at  the  end  of 
training.  Ratings  are  made  using  the  scale  shown  in  Figure  4.  This  is 
the  same  scale  as  utilized  in  the  TRAINVICE  model  for  the  criterion 
scale  used  in  the  Training  Deficit  Analysis,  with  the  exception  of  the 
"0"  point  on  the  scale. 

As  noted  previously,  this  scale  is  adapted  from  Demaree  (1961). 

Once  again,  it  is  to  be  noted  that  this  analysis  is  concerned  with 
training  criticality  and  not  mission  criticality,  although  mission 
criticality  may  enter  into  the  determination  of  training  criticality. 

As  noted  in  Reg  350-100-1,  the  standards  for  skills  are  usually  derived 
from  the  standard  established  for  the  task  or  subtask.  However,  this 
standard  must  be  tempered  by  the  nature  of  the  skill  and  the  degree  to 
which  the  training  on  the  skill  will  be  merged  with  subsequent  on-the- 
job  training  and  the  degree  to  which  the  training  is  embedded  in  other 
aspects  of  the  training  program  than  that  involving  exposure  to  the 
device . 

Training  Difficulty  Analysis.  In  addition  to  assessing  the  level 
of  proficiency  required  for  each  of  the  required  skills,  an  assessment 
is  made,  in  the  Training  Difficulty  Analysis,  of  the  degree  of  difficulty 
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wlili'li  Is  ti)  l)i'  fxpfi' I i-il  ill  .ittalniii^  tii.it  li'Vfl  iit  iniil  1 1- 1 imhv  , lor  l tu‘ 
parllciilar  skill  and  traliioo  population  Inviilvod.  As  soon  in  I'ip.urf  -i , 
a soal«'  witli  tour  points  is  nsmi.  This  soalo  is  mod  i 1 i oil  I roni  that  ot 
Kankin  (1‘1/S).  in  dot  I'tininlnn  this  r.itin^;,  t ho  lol  lowing  laotors  must 
ho  t .ikon  into  aioount,  I ho  inhoront  dlttloulty  ol  t ho  skill,  t ho  .imount 
ot  plot  to  li'iKV  in  I lu-  skill  hv  t lu’  trainoi’  popul.ition  duo  1 1>  prior 
tr.ilnin>t  or  oxporloiiio,  .iiul  t hi'  lovol  ii|  prol  io  Ionov  ro(|ulrod  .it  t ho  ond 
ot  tho  li.iluin^t,  as  rotlootod  in  Iho  ir.ilnln>t  orltlo.illtv  r.itliip,.  Whllo 
no  lorm.il  prooi'dutos  aro  rooommondod  lor  t lu-  assi'ssniont  ot  o.ioh  ol  l hoso 
l.iotois,  oaoli  must  ho  taki'ii  into  aooouiit  hv  t hi'  analyst.  lliis  is  .i 
similar  proooduro  to  that  tollowod  in  dorlvinn  tho  woluhtod  lo.irnlnp. 
doliolt  sooro  in  tho  TRAlNVltlK  iiiodo  1 . It  m.iv  ho  roo.illod  th.it  tor  th.il 
dorivatlon,  i rating  is  nivon  lor  o.ioli  skill  rol.it  Ivo  to  tho  donroo  ot 
protloloncv  hold  hy  tho  tralnoos  at  tho  houlnnlnn  ol  tho  trainini-  .ind 
also  .It  tho  ond  of  tho  Ir. lining  .iiul  tho  two  .iro  suhst  r.iot  od . I'hon  t ho 
siiht.isks  aro  rank  ordori'd  on  dltlliultv.  Tho  r.inks  woro  thon  multiplioil 
hv  tho  mo. in  siiht.isk  dolioit  to  ^ivo  tho  wolt'htod  di'llolt  sooro.  it  was 
tolt  during  tho  applioation  of  t hi'  I'RA  I NV 1 td'!  modol  to  t hi'  malntonanoo 
tr.ilnors  that  tho  r.ink  ordorlnn  of  tho  suhtasks  on  ditfloultv  was  dltli- 
oult.  In  tho  rovlsoil  modol,  oaoh  of  t hi'  skills  Is  rati'd  .i^.iinst  ,in 
.ihsoluti'  so, ill'  ol  d I f I i oil  1 1 v . 

Dovloo  tdiar.iot  or  Ist  los  An.ilysos.  Up  to  this  point  wo  liavo  boon 
oonoornod  with  assossln^  what  skills  aro  oovoroil  hy  tho  dovioo,  tholr 
"tit"  to  tho  training  objootlvo,  and  why  tho  skills  havo  to  ho  inoludod 
in  tho  training  situation.  Wo  now  turn  our  attontlon  to  how  t hoso 
skills  aro  to  bo  tau>;ht.  In  ordor  to  do  this,  attontlon  must  now  ho 
t iirnod  illri'otly  to  tho  ili'Vloo  anil  its  oharao  lor  1st  los . Up  to  now,  tho 
dovioo  has  boon  oonsidoroil  onlv  I rom  t lu'  point  ol  vlow  of  tho  oovora^o 
ol  tho  di'slrod  skills  and  knowlodno  that  it  offors.  It  may  ho  rooalli'd 
th,it  tho  rRAINVlCF.  modol  lookod  at  tho  displays  .ind  oontrols  in  tho 
I’hvsioal  and  Kuiio  t ioiia  1 Similarity  analyst's  and  at  tho  suhtasks,  t rans- 
latod  into  bohnvloral  oali'norlos,  in  lorms  of  how  woll  oortain  prlnolplos 
woro  iitlllzod  hy  tho  dovioo.  In  ossonoo,  tho  physloal  and  tho  tiinotlonal 
oharao t or  I St los  of  tho  dovioo  woro  oonsidoroil,  and  It  is  t hoso  two 
aspoots  that  aro  hrokon  out  and  oonsidoroil  in  tho  Uovioo  t'.haraotor  1st  los 
Analysos  of  thi'  rovlsoil  modol.  ITioroforo  thoro  aro  two  analyst's;  tho 
I’hvsioal  Uharaotorlst ios  Analysis  and  tho  Knnot lonal  Uharao t or  is t i os 
Ana  lysis. 

I’liysloal  Uharaotor  ist  los  Analysl^i^.  In  tho  TRAINVICK  modol,  a 
I’hysloal  and  a Kunot lonal  Similarity  analysis  was  porformod.  It  may  bo 
rooallod  that  tho  moro  similar  tiu'  physloal  or  funotlonal  aspoot  of  tho 
display  or  oonlrol  on  tho  training  dovioo  rolat Ivo  to  tho  oorrospondlnn 
dlspl.iy  or  oontrol  In  tho  oporat  lonal  situation,  tho  lilghor  tho  rating 
Kivon.  This  was  hasod  on  tho  promlso  that  tho  uroator  tho  similarity, 
tho  uroator  tho  transfor  poiontlal.  llowovor,  this  may  bo  calloil  Into 
(|iiostton.  As  R.  Mlllor  (l‘)S/i,  p.  29)  has  polntod  out,  "Tho  doslgn  of 
trainiiiK  dovloos  should  bo  dirooloil  towards  niaximnm  transfor  of  training 
valuo,  not  physical  roallsm."  Ho  fnrthor  siatos,  "Somo  stages  of  train- 
ing and  kinds  of  task  trained  require  less  physloal  realism  than  others," 
and  "The  kinds  and  extent  of  physical  realism  built  Into  a given  training 
dovioo  should  bo  based  upon  oarofiil  examination  of  what  Is  psychologloal ly 
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i iiipot  t .iiu  , " Di'in.i  I t'l'  ( 1 'M>  1 , |i.  li.r.  f..inl  lli.il  "...llic  );ciiir.il  i u I f In 

to  t I'lH  fSl'III  till'  01)l't.ll  lOll.ll  1(111  i (IIIU’Ill  Ml  tll.lt  to.lliMU  Is  .Itt.llllisl  ultli 

ro)’,.itil  to  wli.it  i.s  to  ho  lo.iiiioil  .iiul  not  to  tlio  opot  .it  I oiia  1 oipi  1 pinoii  I . ” 

111  otlioi  woiils,  iiioto  spooillo  oiltor.i  .iro  ro(|uiroil  lot  the  i- v.i  I n.it  1 on  ol 
till’  ti.insli’i  potonli.il  ol  t lio  plivsio.il  olnirao  t or  i s l i os  of  t ho  tr.iinlnK 
ili'vioo,  in  tonus  ol  thi-  st.ip.o  o|  lo.iinin)’,  .mil  typo  ol  hoh.ivlor  Involvoil 
t li.in  .1  simplo  oor  to  I .It  i on  with  I ho  plivsio.il  i li.ir.iot  or  i st  ioi.  ol  tin- 
iipi' rat  i on.i  1 ispi  i pnuMit  . K.  Mi  1 lor  (I'lhih,  o),  Doni.iroi'  (I'Jhll,  Millor 
(14/4),  Kink.iilo  .iiul  Wlusiton  (14//),  l.nnisda  i no  (1460),  Mnoklor  (14')4), 
ihiro  (14/1)),  Kloin  (14/1))  ,iiul  .Siiunlo  (1471)  .iro  .imonn  t hosi'  who  liavo 
.iihl  ro.ssoil  till’  prohlisii  ol  t ho  plivsioal  ohar.io  t I'r  i si  i os  or  "fliiollty”  ol 
Itaininp,  ilovioos.  I'liov  ilo  Kivo  roi  oiraiioiul.it  ions ; howovor,  lor  t ho  most 
p.irt  t hoy  ooiisiiloi  ol.issos  ol  ilovioos,  or  p,ross  oli.i  rao  t or  1 st  i cs  , anil  do 
not  uso  t ho  sanio  o l.iss  i 1 io.it  ions  ol  dovioos  or  hoh.iviors.  It  is  dilli- 
onlt  to  oxlr.ipolato  to  tlio  KoiU'tio  oli.i  r.io  t o r i st  i os  ol  dovioos  and  to  ,i 
p.irtionl.ir  dovioo.  Mnoli  work  is  still  noodod  to  oomo  up  with  Kui'lvlinos 
to  assist  tho  an.ilyst  in  .issossin>;  .i  spooil  io  display  or  oiio  prosontod 
hv  .1  di-vioo,  or  to  oomp.iro  ono  dovioi-  within  .i  p.irt  ioular  olass  ol 
dovioos  with  anothor  dovioo  .is  to  its  translor  potontl.il.  Howovor,  tho 
prooodiiro  lollowod  in  tho  ori>;in.il  TRiMNVKlK  modo  I ol  oorro  1 at  i np,  phvsi- 
oal  ami  lnnotion.il  si  mi  lari  tv  with  transli'r  potinitial  was  rojootod  as 
hoinp  too  ripid  .ind  indoisl  possibly  m i s 1 o.id  i np . Whilo  C.iro  (1470)  h.ul 
.ulvooatod  .1  prooodiiro  in  whioh  tho  stimuli  and  rosponsos  in  tho  opora- 
t ional  and  traininp  situations  .iro  oompari’d,  in  whioh  positivo  translor 
was  assnmod  to  ooonr  whon  hoih  stimuli  and  rosponsos  woro  similar,  ho 
w.is  .ilso  conoornod  with  tho  st  imn  Ins-rosponso  pairinp,  prodiotinp  nopa- 
tivo  translor  whon  tho  stimuli  woro  similar  but  tho  rosponsos  to  tho 
similar  stimuli  woro  dilti'ronl,  somothinp  not  adoqiiatoly  oonsidorod  in 
tho  TRiMNVlCli  prooodiiro.  Aiso,  tho  Caro  analysis  was  performod  within 
tho  oontoxt  of  instrnmont  flipht  sinmlators,  a complox  poroopt iia 1-motor 
boh.ivior  that  nuiy  indood  call  for  a hiph  dogroo  of  realism  in  tho  train- 
ing, but  which  may  not  roprosont  a valid  roqniromont  for  othor  typos  of 
behaviors.  In  casting  about  for  guidance  for  a procedure  to  assess  the 
physical  characteristics  of  a device,  it  was  decided  to  combine  tho 
procedure  suggested  by  Braby,  et  al  (1975)  of  the  Navy  Training  Analysis 
and  Kvaluation  Croup  in  conjunction  with  their  Training  Kf f ect ivoness 
Cost  Effectiveness  Prediction  (TECEP)  technique  with  selected  guidelines 
from  the  Interservico  Procedures  for  Instructional  Systems  Development 
(the  ISl)  mode  1 ) (TRADOC  1975).  These  guidelines,  it  should  be  noted,  are 
a simplified  version  of  the  learning  guidelines  developed  by  Aagard  and 
Braby  (1976)  in  conjunction  with  the  TECEP  model.  Various  sets  of 
guidelines  were  considered;  those  formulated  by  Willis  and  Peterson 
(1961),  Gagne  and  Briggs  (1974),  an  earlier  set  by  Braby  et  al  (1972) 
(which  was  the  set  used  in  the  Training  Techniques  Analysis  of  the 
TRAINVICE  model),  the  Aagard  and  Braby  (1976)  guidelines,  and  the  sim- 
plified version  of  their  guidelines  given  in  the  ISO  model  (I’RADOtl 
1975).  In  order  for  the  revised  model  to  have  widest  applicability,  the 
guidelines  from  the  ISD  model  were  adopted.  These  guidelines  deal  for 
the  most  part  with  functional  aspects  of  the  training  situation,  such  as 
the  sequencing  of  learning  events.  However,  selected  guidelines  were 
chosen  as  being  applicable  to  the  design  of  specific  elements  of  the 
device  or  training  situation.  These  specific  elements,  be  they  dlsplays- 
controls,  Inputs-outputs , or  cue-response  pairs  may  be  likened  to  the 
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simulation  elements  of  Smode  (1971).  The  adequacy  of  these  simulation 
elements  determine  the  perceptual  equivalence  of  the  training  and  opera- 
tional environments.  They  are  the  elements  in  the  total  mosaic  of  the 
training  device,  which  essentially  is  a spatial  and  temporal  placement 
and  sequencing  of  these  elements  and,  as  Matheny  (1974)  has  pointed  out, 
the  assumption  may  be  made  that  it  is  perceptual  equivalence  that  results 
in  positive  transfer.  To  bring  the  number  of  possible  specific  forms 
that  each  element  may  assume  into  manageable  proportions,  it  is  neces- 
sary to  translate  the  specific  skills  to  be  represented  on  the  training 
device  into  behavioral  categories  and  the  specific  simulation  elements 
must  be  translated  into  generic  characteristics. 

The  guidelines  extracted  from  those  in  the  ISD  model  give  limited 
guidance  to  the  analyst  as  to  the  specific  physical  characteristics  that 
the  cues  and  responses  should  take  for  maximum  transfer  potential  for 
the  type  of  behavior  involved.  Therefore,  the  analyst  must  make  a 
judgment  as  to  what  generic  characteristics  are  required.  His  judgment 
as  to  what  is  required  is  merged  with  his  assessment  of  how  well  the 
generic  characteristics  of  the  cue  or  response  do  follow  the  available 
guidelines.  In  order  to  make  these  judgments,  a list  of  generic  charac- 
teristics dealing  with  the  stimulus  and  response  characteristics  of  the 
training  device  are  used.  This  listing,  given  in  Figure  5,  is  taken 
from  the  listing  given  in  the  TECEP  technique  of  Braby,  et  al  (1975). 

To  make  this  judgment,  the  skill  is  first  placed  into  one  of  the  behavioral 
categories,  shown  in  Figure  4,  which  was  also  taken  from  the  TECEP  tech- 
nique, and  which  is  also  utilized  in  the  ISD  model.  This  permits  access 
to  a list  of  guidelines  to  the  physical  characteristics  deemed  desirable 
for  each  of  the  behavioral  categories.  Then  the  cues  and  associated 
responses  subsumed  under  each  skill  are  considered,  utilizing  the  list 
of  generic  characteristics.  The  cue  or  response  is  categorized  into 
each  of  the  applicable  generic  characteristics  and  to  each  characteris- 
tic a rating  is  given,  using  the  scale  shown  in  Figure  4.  This  scale 
ranges  from  a "0"  rating  which  means  that  that  generic  characteristic  is 
not  adequate  from  the  point  of  view  of  the  analyst's  judgment  of  what  is 
required  and/or  the  implementation  of  the  applicable  guideline  to  a 
rating  of  "3"  which  represents  an  outstanding  implementation.  Therefore, 
each  cue-response  pair  involved  in  each  skill  represented  by  the  train- 
ing device  receives  a cluster  of  ratings  on  the  applicable  generic 
characteristics.  The  pattern  of  these  ratings  will  serve  to  "highlight" 
the  various  physical  characteristics  of  the  device,  both  the  outstanding 
aspects  and  those  that  require  change.  They  may  serve  as  a profile  of 
the  characteristics,  much  as  that  proposed  by  Smode  (1971).  In  order  to 
derive  the  Physical  Characteristics  rating  for  the  skill  involved,  the 
ratings  given  on  each  of  the  generic  characteristics  are  added  to  give 
the  total  for  that  skill.  Therefore,  the  presence  of  a "0"  rating  does 
not  eliminate  that  skill  from  the  total  rating  but  does  serve  to  down- 
grade the  total  rating  for  the  skill.  In  order  to  derive  a baseline 
against  which  the  rating  may  be  compared  in  the  final  device  rating,  the 
number  of  generic  characteristics  involved  is  multiplied  by  "3,"  the 
highest  possible  rating,  to  give  the  maximum  possible  rating  for  that 
skill  as  far  as  Physical  Characteristics  of  the  device  are  concerned. 
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<TI)»l.LUS  CAj>ASlLlTi:S 


V<>u4il  • wor>i».  nuucrt  and  otK«c 

•yvboLj  pr«»«nc«4  £r*pAtcjllv. 

Vnu^^  Plc;ort*..  Pl4S<  - • C'wp><ii3*naton4l 
tAa4«,  « r«pr««*^c«tijn  ta  t^•  (on  o(  « 
pKoco|r«ph  or  drawln|. 

Vlottol  Ltao  C jn»t rut 1 1 ;n,  Plano  - « two- 
•jlaonaiotul  :idur«  o(  linai,  as 

a MthaaatlcAl  £jrvt  or 

Vliual  Objtct.  SoltJ  - a tnrao-dlaansional  laaga 
or  raalicf  c;^c  i*  vl«v«d  (rsa  ascarior 
parapacclva*. 

VtauAl  Eavtronaaat  * A thrav-dlaanslonal  laaga 
or  raalUjr  c'la:  vlr«a<l  (m  lns;J«. 


6.  Visual  >elit  • a s:atic  'Visual  (ISid.  aa  with  a 
still  photofrapo.  drsMing,  or  prtactd  paga. 

7 /tsual  Llalttd  **>.-v»aa'^t  • a basically  static 
visual  (laid  altb  alaaants  that  cart  e>a  aadv  to 
aova,  as  wltii  as  aslaaiad  transparancy  or  slapla 
pansl  with  swic.'as  ;nat  sova. 

8-  Visual  Full  yovaasf:;  - a vlsoal  (laid  In  which 
all  alaaants  catt  ^ va,  as  with  a cotton  ptctura. 
(light  slaulatof'  o'  coaratlcnal  aircrtfc. 

9 Visual  Cy;ll;  «*;  varan;  - a .‘sual  (tali  whlcn 
»vas  through  a rl^aJ  ^a^jarta  and  than  ra*>aa:s 
rha  saquaQca  In  a -asatltlva  '^annar,  as  with 
a fils  loop. 

V 1 sva I Spacerua 


^Vuc.k  and  WStta  - a visual  tlaVu  ctnpi-'iad  cl 
either  blick  or  vtiita  alanancs,  as  with  tha 
prlntao  pa«a  or  li~a  drawings. 

ll.  Cray  Scale  - a visual  (laid  :oxposad  ■'(  blaLk, 
white  and  conti^*ouB  gradatlvns  o:  gray,  .is 
with  a black  anc  ^"hlta  photcrraah  .^r 
television  plot. re. 

1--  Color  - a visual  rteli  conpcsaJ  of  vinous 
sagnar.ts  o(  the  vts.til  spactrasi,  ai  with 
color  talaviilir  e;  action  pictures. 


1).  Exact  Seal*  - a-t-sl  visual  field  or  a ona-to- 
or.a  raplicjtlna  that  (lalJ  as  with  a full- 
sired  anc>-uo,  sit.lator.  or  operational 
s/staa. 

14.  rr<^nor; '.onal  ^tsla  • a reprasm;  a*  lor.  o( 

reality  m ot.nar  t*-n  fi.il  stale,  su:h  as  a 
Swalad  aodal  rap  cr  p-.otccnoh. 


IS.  Voice  Sound  quality  of 

round  which  ena.-Ia»  sorVen  wrrds 
jsed  at  the  zee:  = •;  C0TTu-*iwJtiv-J.  kut 
no:  Sulcal  t>  rcra  .-•’undlng  t.isks,  sjkh 
as  "uslt  Of  s?;-!  'scagnit trn  afStclS'S. 


16.  Full  Sound  Range  - a quality  of  aouod  reproduction 
chat  contalna  all  the  significant  clssants  of  the 
sound  and  is  suited  to  tha  daaandlng  task  of 
aound  recognition  axerriaea. 

17.  Aiablenc  _Spunds  - a copplax  sound  cnvlronaaac  with 
sounds  enanaclng  froa  vsrioua  sources  and  (roa 
various  dlrecclona,  Including  background  nolso 
and  cask  algniflcanc  sounds. 


IS.  Tactile  Cuss  > signals  racaivad  through  tha  sense 
of  touch,  including  svnaatlons  related  to  texture, 
alee  or  shape. 

19.  Internal  Stlaulus  Motion  Cues  - tha  aanaaclona 
felt  by  a parson  when  he  aoves  his  sra,  leg, 
fingers,  etc. 

20.  External  Sclaulus  Motion  Cues  - the  sensations  felt 
by  s person  when  he  Is  moved  by  some  outside  force 
in  su(.h  a way  chat  hit  body  experiences  roll, 
pitch,  yaw,  heava,  sway  and/or  surge. 

TRAINEE  RESPONSE  MOOES 

21.  Cjjfert  Response  - s response  which  the  trainee 
creates  in  his  tslnd  but  does  not  express  In  an 
observable  manner. 

22.  Multiple  Choice  ••  a response  node  in  which  a 
trainee  selects  a response  (ron  a liulced  set  of 
responses . 

2).  Pre^progf tjied  Verbal  Perforaance  a response 
node  in  which  a trainee  creates  a short  answer 
to  a question  having  a limited  set  of  correct 
answers. 

24.  Fre^e-^tyle  Urltten  P.»rfornance  - a response  stode 
In  which  « trilnce  writes  a response  In  his  own 
wnrds. 

2^.  Pe/ is! jn  IrJicator  - a verbal  or  perceptual 
motor  reap.-inse  In  which  the  trainee  indicates 
that  he  has  made  a divergent  type  decision. 

26.  Voice  Perfamance  - a response  tsode  in  which  a 
tr-iinee  speiks.  Including  conversation. 

27.  Fine  M verent  Mjnipuljtxv  Acts  - a response 
mode  in  which  a trainee  makes  discrete  and 
s-.ill  novenencs  nf  dials,  switches,  keys  or 
makes  sensitive  ad justr*ent s to  instruments- 
Act  ray  involve  use  of  small  instruments. 

25.  Movnent  V«ntpulative  .\ct8  - a response 
node  In  which  i trainee  rike*  large  novenents 
of  levers  or  wheels  on  large  pieces  of  equip- 
ment or  by  the  use  of  hand  held  tools. 

Trs’klnfa  - a response  rode  in  which  a trainee 
f ont  Inuo'.slv  controls  a constantly  changing 
svscen.  such  as  steering  an  automobile  or 
h.iHi-g  .1  C3np>ji  bearing  in  st-*ering  a ship. 

'0.  Proceiun;  1 > ll  It ive  Acts  - a re*-onse  fj.'de 
in  which  a tral"ee  nerter-s  ine  s-.-quence  of 
steps  in  .1  pro.-ef-  re,  such  as  in  tie  carrying 
out  of  the  l;.-s  on  the  checklist  l.-t  pro- 
fli^htlng  in  aircr.ift  or  turning  on  a radar 
syste-a. 


Figure  5.  Generic  Characteristics  List  Use 
(From  Braby  et  al,  1975) 


sed  Mode 


rill-  ii-im  i n-nii-iit  imposi-il  uihmi  l ho  .inalvsl  t ii  m.iki-  .1  jiul^-.moiu  as  (a 
t ho  gonorlo  ohaiao  I 01  t s l i 0 i onu  i t oim-iit  s tollaws  tiiat  ullli/oJ  in  l ho 
I'Kl’KI’  t oohn  iijiii' . I'h.it  toohnii)iio,  howi-voi  , is  ooiuii  lu-il  with  t ho  soKo- 
l Ion  ot  an  i ns  t t no  t iona  I Jolivoiv  svstoni,  at  whi.h  a liainin^;  ilovioo  is 
hotli  ono  a 1 1 ornal  i VO  . liulooil,  l lio  TlXlKi’  loohnimio  ^tivos  1 i-oamnuiulat  ions 
as  to  whioh  ilolivoiv  svstoms  pormit  t ho  applioalion  at  t lio  loavnin^ 
giiKiollnos  tor  oaoh  ot  t ho  hohavii'ial  oatoi;orios;  i ooar.u«otulai  ions  hasoil 
on  tho  pattorn  of  m.itoliin^  of  tho  >;i-not  io  olia  rao  1 01  i st  i os  inhoronl  in 
tlio  various  ilol  ivory  svstoms  aiul  t hoso  iiuljtoil  to  ho  nooossarv  tiv  tin- 
analvst.  .lornonson  il47ti)  has  utili/i-d  a similar  mairix  .ipproaoli  in 
wliioh  tho  loijniroil  >;onorio  ohat  ai- 1 or  i s t ios  aro  mat  olu-il  against  various 
moiiia,  of  wlitoli  trainiiiK  ilovlcos  aro  hut  ono  olass,  in  arJoi  to  soloot 
training  oonoopts  (or  moilia)  most  suitahlo  tai  training  various  tasks. 
Similar  prooo  luros  mav  ho  fouinl  in  thi-  1 SI)  iiuvlol  ( I'RADi'f , I')/*)!  fwhioh 
is  takon  from  tho  I'Kl'Kl’  tooh'linuo),  tho  Air  Katoo  llanilhoak  tar  I'osignors 
of  I nst  ruo  t iona  1 Svstoms  (l')7a),  Tarkor  .nul  I'liwns  il'tlill,  Nunnollv 
(l‘>hhl,  Bonnik  aiui  Hoyt  (1^77),  Biot/  (1971)  aiul  tho  roviow  hv  Spangonhorg, 
Rih.iok  and  Moiui  (1971).  llowi-vor,  t hoso  praoi-duros  aii-  intondod  for  t ho 
soloot ion  of  or  oomparlsan  at  v.iriaus  modia  or  i nst ruo t i ana  1 dolivorv 
svstoms  rathor  than  tin-  sorut  inv  of  a training  dovioo  por  so  01  oi'mp.iri- 
son  at  training  dovioos. 

It  will  ho  rooallod  that  in  tho  IKAlNVlt'f  madol,  t lio  analvst  looks 
at  tho  displavs  and  oontrols  and  oaniparos  oaih  witli  its  oountorpart  in 
tho  oporational  situation  and  givos  it  a rating  an  ptiysioal  and  Innotional 
similarity.  I'ho  phvsioal  similarltv  rating  lias  boon  ropl.iood  in  t ho 
rovisod  madol  hy  tho  proooduro  givon  .ihovo  tor  tho  roasons  disoussod 
ahovo.  Tho  funotional  similarltv  analysis  has  boon  drv'ppod  as  it  was 
found  in  tho  applio.ition  to  t iio  malnton.inoo  trainors  to  poso  a dittlonit 
dooision,  not  stiitahlo  for  .1  proooduro  .itmod  at  a wido  spootrum  of 
usors,  and  was  ossont tally  t lod  to  tho  physloal  oh.irao t or  is t lo  , spooifi- 
oallv  hoing  dotorniinod  hv  tho  numhor  of  st.it  os  (whioh  in  manv  oases  woro 
ditfioiilt  ti'  ilotormino)  whioh  oould  ho  .issnmod  hv  tho  dlsplav  or  oontrol. 

Kiinot  ional  t'har.iolor  ist  ios  .Analysis.  ITio  other  analysis  suhsnmed 
under  tho  Dovioo  llhar.iet or i st  i os  An.ilysls  is  that  oonoorned  with  tho 
tunot  ional  oli.iraoterist  ios.  Whilo  tho  I’livsioal  idiaraot  or  ist  ios  .inalysis 
is  oonoernod  with  tho  analysis  ot  tho  elomonts  of  tho  tr. lining  dovioo 
per  so  the  funotional  an.ilysls  is  oonoorned  with  how  those  elements  .ire 
utilized.  Hits  .in.ilvsis  mav  ho  oomparod  lo  the  Tr.ilnlng  Veohnlques 
/Analvsis  ot  the  TRAINV’U'K  model.  As  in  th.it  .inalysis,  tho  operations  of 
the  dovioo  .ire  oomparod  ag.iinst  guidelines  to  .isoortaln  to  what  extent 
"good"  training  pr.iotloes  aro  tollowod.  Certain  ohanges  h.ive  heen  m.ido, 
however.  Instead  of  using  the  suht.isk  as  the  unit  of  oonoern,  eaoh 
skill  is  .inalvzed.  It  was  found  during  the  applioalion  o>f  the  model  to 
tho  m.ilnlen.inoe  trainer,  that  there  often  was  oonfusion  .ind  .it  tiroes 
even  oonflloting  guidelines  to  he  oonsidored,  as  the  siiht ask  was  broken 
up  Into  several  behavioral  oategories,  e.ioli  with  its  own  set  of  guidelines. 
In  the  revised  model,  o.ioli  skill  is  translated  into  one  of  the  hehavlor.il 
categories  (those  used  In  the  ISD  model),  hs  shown  in  Figure  4,  and 
only  that  set  of  guidelines  Is  considered.  Tlie  guidelines  have  heen 
changed  to  those  used  in  the  ISD  model,  as  vipposed  to  the  earlier  Br.ihy 
guidelines  whioh  were  used  hy  the  TR/\INVICK  model.  These  guidelines  .iro 
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telt  to  bo  more  st raiul't forward  and  moro  suitable  for  a wider  spectrum 
of  users. 

Tlierefore,  to  perform  this  analysis,  each  of  the  skills  is  translated 
into  one  of  tlie  beliavioral  categories  given  in  Figure  4.  The  appropriate 
set  of  guidelines  is  consulted,  as  tlie  functional,  dynamic  characteristics 
of  tile  elements  involved  in  training  for  that  skill  are  considered. 

First  a determination  is  made  if  the  particular  guideline  is  applicable. 

If  it  is,  a rating,  using  the  scale  shown  in  Figure  4,  is  made.  As  in 
the  Physical  Characteristics  analysis,  the  scale  ranges  from  "0"  which 
means  that  the  guideline  is  not  adequately  followed  in  the  training  for 
that  skill  up  to  a rating  of  "3"  which  represents  a judgment  of  outstand- 
ing implementation  of  the  guideline.  Therefore,  each  of  the  applicable 
guidelines  receive  a rating  for  that  skill.  In  order  to  derive  the 
Functional  Characteristics  rating  for  the  skill,  the  rating  given  for 
e.ach  of  the  applicable  guidelines  are  added  to  give  the  total  for  that 
skill.  The  guidelines  not  deemed  applicable  are  not  considered  in  the 
ratings.  As  the  total  is  derived  through  addition  rather  than  multipli- 
cation of  the  individual  ratings,  the  presence  of  a "0"  rating  does  not 
eliminate  that  skill  from  the  total  device  rating,  but  does  serve  to 
downgrade  the  rating  for  the  skill  and  also  may  serve  as  a "flag"  for 
something  that  needs  to  be  corrected.  It  will  be  recalled  that  in  the 
TRAI.NVICE  model  the  lowest  rating  was  used  and  all  other  ratings  dis- 
carded. It  was  felt  that  this  was  a waste  of  valuable  information,  and 
possibly  misleading,  as  the  one  low  rating  could  obscure  the  presence  of 
other  high  ratings.  The  revised  procedure  takes  all  the  ratings  in*-o 
account.  In  order  to  derive  a baseline  against  which  the  rating  may  be 
compared  in  the  final  device  rating,  the  number  of  applicable  guidelines 
is  multiplied  by  "3,"  the  highest  possible  rating,  to  give  the  maximum 
rating  for  that  skill  for  functional  characteristics.  This  would  represent 
a device  with  outstanding  application  of  all  the  applicable  guidelines 
for  the  behavior  within  which  the  skill  falls. 

In  applying  guidelines  during  the  course  of  the  Training  Techniques 
/Vnalysls  in  the  use  of  the  TRAINVICE  model,  some  difficulty  was  encountered 
as  the  unit  of  activity  emcompassed  in  a subtask  did  not  lend  itself  to 
application  of  the  guidelines,  as  many  guidelines  were  concerned  with  a 
sequencing  of  events  which  covered  a more  extensive  period  of  time  than 
covered  by  the  subtask.  While  this  problem  may  be  accentuated  by  the 
use  of  skills  as  the  unit  of  activity,  the  possibility  also  exists  that 
since  skills  exist  over  subtasks,  the  match  of  unit  of  activity  and 
guidelines  may  be  enhanced.  It  depends  upon  the  particular  task  and 
subtasks  involved.  This  problem  tends  to  arise  from  the  fact  that  the 
guidelines,  both  those  used  in  the  original  TRAINVICE  and  the  revised 
models,  originate  from  those  Intended  to  be  used  for  instructional 
system  development  and  instructional  delivery  system  or  media  selection, 
of  which  a training  device  may  be  one  small  segment.  The  development  of 
more  specific  guidelines  is  required. 

Derivation  of  Index  of  Predicted  Training  Device  Effectiveness.  It 
will  be  recalled  that  the  derivation  of  the  Index  of  the  effectiveness 
of  the  training  device  utilized  In  the  TRAINVICE  model  was  based  on  one 
of  the  formulas  discussed  by  Gagne,  Foster,  and  Crowley  (1948)  to  express 
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transt'fr  of  craiiiliiK  in  terms  of  empirical  data.  The  equation  formulated 
for  use  with  the  revised  model  also  follows  a procedure  discussed  bv 
Cattne,  Foster,  and  Crowley  (1*148).  While  not  based  on  one  of  their 
formulas  directly,  it  is  In  keeping  with  their  conclusion  that  the  most 
useful  and  practical  type  of  formulation  Is  that  b.ised  on  percentage  of 
maximum  possible  transfer.  It  .assumes  that  If  the  device  were  to  follow 
perfectlv  all  of  the  guidelines,  as  judged  necessary  by  ttie  analyst, 
that  maximum  transfer,  which  could  be  attributed  to  the  device,  would  be 
the  result.  This  forms  the  baseline  against  which  the  device  under 
evaluation  is  compared.  Therefore,  the  maximum  possible  score  for  the 
Physical  Characteristics  Analysis  .ind  the  m.jxlmiim  possible  score  for  the 
Functional  Characteristics  Analysis  added  together  would  represent  the 
"perfect"  device  for  tlie  training  of  tliat  particular  skill.  This  total 
is  weighted  by  the  Coverage  Requirement,  Coverage,  Training  Criticality 
and  Training  Difficulty  scores  derived  for  that  skill.  The  derived 
.score  for  each  skill  is  then  compared  with  the  score  representing  mtixlmum 
expected  transfer.  (If  a "0"  rating  is  given  for  either  the  Coverage 
Requirement  or  Coverage  Analysis,  the  total  score  for  that  skill  is 
reduced  to  "0"  and  makes  no  contribution  to  the  derived  index  for  the 
device.)  To  derive  the  score  for  the  total  device,  each  of  the  skill 
scores  is  added.  Therefore,  the  index  of  predicted  training  device 
effectiveness  is  as  follows: 


ICCR  .X  C X Ci  X D .X  (PC  FC))i 
KCR  X C X Cl  X D X (PC^j,^  + FC^,^))i 


where : 


CR  Cover.ige  Requirement  Score 

(.'  Coverage  Score 

Ci  Training  Criticality  Score 

D Training  Difficulty  Score 

PC  Physical  Cli.tract  er  ist  ics  Score 

FC  Functional  Ch.irac  ter  ist  ics  Score 
PC„,„  Maximum  Possible  Plivslcal  Characteristics  Score 

lUtiX 

*’^'max  Possible  Functional  Characteristics  Score 

for  each  skill. 


This  equation  will  vield  an  index  ranging  from  0 to  1.  The  larger 
the  index,  the  higher  were  the  ratings  given  on  the  Device  Characteristics 
Analyses  and  presumably  the  greater  the  potential  for  transfer  of  train- 
ing. 
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I 1 IXl  : I'ctin  n loti  of  cost  offootuo  tr.iintiij:  proj^rams  : 

\ siiram.irv  t>f  lurroiit  rosoaroh  oifort'-  with  ai'jili 
oat  i oil  to  tori-oast  iiij;  fiitiiro  training  roijiii  t «.-miTit  s 

MrnU'KS;  I'r.  Jolin  R.  t'hioriiu.  Mr.  Molvin  H.  Ri'soii , and 

I'r.  Rohcrt  W.  Sw<.‘.:oy 


ORli.V.S  I n A1  lO.N  : 'll’ 1 U'li  U's  .Systoras  liovolopiniMit 
I 1 1 ton  Sys  t oni , lilo  . 
r.o.  Bo\  i:s« 

Sjifllljlf  ll’ld.  \ \ JJ151 

VH.STRVl'T:  I'liii  papor  pri'scnt-.  tlie  rosiilts  ao'  ovod  .ind  tho  atialytio 

mi'tliod'.  dovolopod  hy  litton  Molloiiios  in  throe  roiont  rosoaroli  otfort-^ 
for  the  II.''\1S  to  dofino  offoctivo  trainin(t  proj;rams  for  the  Mlii,  1 OW  .iiul 
I'KAfiDN.  l u'Ul  oxporimontat  ion  was  not  possihlo  .iiul  honoo  analytio 
proiodiiros  h.id  to  ho  dovolopod  to  support  this  offort  . RooomnH'ndat  ions 
fi’r  Iraininjj  woro  hasod  on  analyses  of  five  factors:  thro, it.  operator 
roiju  i romont  s ; cost,  s.ifoty  and  st.ito  of  the  art  constraints  on  ro.i  I i sm 
in  tr.iininj;;  operator  c.ip.ihi  1 1 1 i os  ; ,ind  knowlodito  of  the  o f foe  t i vonoss 
of  certain  basic  training  principles.  Since  proioctions  c.in  ho  m.ido  a-, 
to  the  status  of  those  factors  in  .i  future  time  the  .luthors  su_i;,i;ost  th.it 
their  method  .iiid  study  loijic  c.in  he  .ipplied  to  the  prohlera  of  ilefiiiiiip 
tr.iiiiiiij;  resource  roipii  rement  s now  for  future  time  frames. 
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Definition  of  cost  effective  training  programs: 

A summary  of  current  researm  efforts  with  ajipli- 
cation  to  forecasting,  future  training  reipii  rement  s 

Dr.  .lohn  K.  t.'hiorini,  Mr.  Melvin  II.  Itosen,  ;iiul 
Dr.  Kohert  W.  .Swe^ey 


ORtiAN  1 ZA'l  U)N  : Mel  Ionics  Systems  Development 
Litton  .Systems,  Inc. 

I’O  Ho.x  128(> 

SpriiiKfielil,  VA  221,S1 


Army  Traininjt  managers  aiul  planners  have  been  presenteil  with  a two- 
fold challenge  to  improve  the  effectiveness  of  weapon  system 
training  programs.  TRADOC  I’.imphlet  71-S  points  out  fh.it  in  many 
instances  soldiers  can  not  achieve  the  accuracy  or  hit  prohability 
of  which  their  weapon  systems  are  theoretically  capalile.  fighting 
and  winning  outnumbered  requires  that  such  ;i  performance  gap  be- 
tween theoretical  and  actual  capabilities  be  closed.  The  first 
challenge  is,  tluis,  to  improve  the  effectiveness  of  current 
training  programs.  I'he  training  planner  must  also  anticipate  in 
the  design  of  training  programs.  Hence  there  is  a second  challenge, 
a need  to  exti'iul  the  current  efforts  and  plan  effective  training 
strategies  now  for  a future  in  which  we  can  anticipate  fewer  training 

resources.  .As  it  is  necess:ir>'  to  devisi'  effective  training  pi-ograms 
for  toda.i',  it  is  also  necessary  to  look  into  the  future  and  defuie 
effective  training  iirograms  under  projected  resource  constraints. 

This  must  be  done  both  for  our  current  weapons  still  in  the  inven 
tor>'  .It  that  future  date,  anil  also  for  future  wea]ion  sistems  so  that 
forec.ists  of  the  reipi  i rement  s for  critical  training  resources  can  be 
m.ule . 


The  iiroblem  of  training  effectiveness  det  e rmi  n.i  t i on  is  not  difficult 
when  empiric.il  data  are  available.  the  .\rm\-  however,  is  attempting 
to  forecast  resource  needs  to  implement  effective  training  for  a 
future  tr, lining  environment.  field  tests  cannot  easil>’  be  run  and 
methods  ,ire  needed  for  predicting  training  iirogram  e f fee  t i x'eness 
th.it  are  not  totally  dependent  on  em|urical  data  collection.  Litton 
Mel  Ionics  h.is  recently  been  iniolied  in  three  research  efforts  for 
the  D.'^AIS  designed  to  analyse  t lu'  training  effect  i leness  ot'  three 
we.ipon  systems:  the  MH.,  IHIV  and  Dragon.  This  |iaper  diseiisses 
our  methods  for  those  studies.  These  training  effect  i \eness  aiialises 
( If  As ) are  germaiU'  to  the  problem  of  future  program  design  and 
training  cost  effectiveness  prediction.  Ihe  three  weaiions  are  b\  no 
means  prototypes  or  futuristic  we.ipons,  but  the  iin-t  liodo  1 og\-  we 
developed  for  identifying  the  d.ila  needed  for  a VIA  for  current 


Research  descriln-d  herein  was  |H-rformed  In  Litton  Mel  Ionics  for 
the  Utiited  .States  .Army  Infant  r\’  School,  f V Henning,  t'lA  under 
contracts  DAA(;.b.)-77-(:-ODd(i,  DAAC.Ap  -- f poll,  .uul  IVAAtLAP  '-•f 
DPI  7. 
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w»\i|uin  systoms  h.is  .i|i|i  I u .1 1 i on  tuf  »lc  I 1 11 1 ii(.;  iirciiiii'  ti.iiiiniy.  pin 
HiMm'-  fur  (lit  lire  utMpnii  -.is  terns  or  I nr  iiirri'iil  we-ipmis  in  seine  tut  lire 
time  triliiie.  In  the  three  stiulles,  time  i».is  net  sntluienl  ter  1 1 e K1 
test  s et'  Mil)  tr. lining;  reeeiiuiieiul.it  leie-  ner  ilell.irs  .i\ .1 1 1 .ih  1 e t'l'r 
live  I'liW  er  l'r,i^;en  t'lriny,.  An  .in.i  I \ t 1 e.l  1 .e.  eppesisl  te  .in  ein|'irii.il 
.ippre.ieh  w.is  lenniriul. 

Ihir  jjener.il  vl.it.i  .111.1 1 vs  is  seheme  is  shewn  m this  t 1 r .1  slule. 
iSl.ini  I HASIt'  Srui>\  I’IANI.  it  pertr.us  hetli  the  seipienee  i)| 
.iii.ilysis  .iiul  eiir  iiiulerl  1 1 ii^i  stii.li  le^jie.  h.isie.illv  we  seiii;ht  te 
il<-t'iiie.  III  terms  et  the  we.ipeii  .le  te.it  .ihl  e thre.it.  the  iiiest  re.ilistu 
t r.i  I n I iix  sven.iries  pessihle.  We  then  eeiis  i ilere.l  1 inn  t .it  ii'iis  inipeseil 
hv  vest  (i.e.,  UIW  .iiiuiiiin  1 1 i en  1 iir  s.iti-ty  (i.e.,  hew  te  pl.iv  siippres 
sien  witheiit  live  retiini  tire)  .iiul  ilet'ineil  tliesi'  ir.iiniiiy.  t r.ule  et  1 . 
likely  te  ret.iin  et  I ee  t 1 veness  witheiit  exeeeiliny.  ev'iist  r.i  1 nt  s . 

thie  h.isie  premise  p,iiule)i  eiir  ettert.  he  .ui'i-pteil  .is  the  iiii'.isiire 
lit  tr.iiiilii^  !•  t t'ei' t 1 veness , the  .ihiliti  et  the  tr.iinee,  .it  the  eiul 
et  tr. lining  te  pert'eriii  th.it  t.isk  er  leh  ter  whuh  he  w.is  tr.iine)l, 
.u>.erilin>:  te  prest.iteil  st  .iiul.irils  .iiul  veiul  1 1 1 iins  . The  si  .iml.i  nls  .iiul 
veiiilitiens  were  iletermineil  t'rem  .in  .in.ilvsis  et  the  thre.it  s 1 1 ii.it  leiis 
with  whivh  the  we.ipen  svsteiii's  eper. iters  were  likel\  1 1'  he  t'.u  eil , 

Ihe  stiirtinn  peint  ter  the  .in.ilvsis  thus  w.is  the  sl.itemeiit  et  t he 
teh  envirenment  te  he  eiiveiint  e reil  hv  the  trainee  .it'ter  he  w.is  eii 
the  leh.  ler  a weapen  system,  this  w.is  .in  .iiiali'sis  et  the  Ihre.il 
te  he  I'iueJ  In',  .iiul  the  pertiirm.iiue  reipiireil  ef.  Ihe  1 lul  i v 1 tlii.i  I 
III  lemli.it,  te  survive  .iinl  win.  I'he  .in.ilvsis  et'  thre.it  previiles 
sever.il  essenti.it  i nuri'il  i ent  s ter  the  I'l  A.  lirst.  st  .iiul.i  ish.  ef 
|ie  rferm.itu  e were  thus  r.it  ien.il  .iiul  the  perferm.iiue  ,i;ap  et  interest 
hevame  net  avtii.il  pe rl e rm.iiue  versus  theeretie.il  wi-.ipen  svsteiii 
v.ip.ih  1 1 i t I es  , hilt  .u'tii.il  pert'enii.iiue  vi'rsns  rat  ien.it  Iv  ilerive>l 
perferm.iiue  reijiii  remeiit  s . .Seveiullv,  tr.iiniiii!  eeiulitiens  eeiiKl  he 
iii.iile  re.ilistiv.  I'he  tr.iinee  eeiil)!  he  t ra  i lusl  te  eeiinti'r  leiiilitiens 
similar  le  these  he  weiilil  mest  likely  e xpe r I eiue  en  Ihe  h.ittli' 
fielil,  fills  IS  rensistenl  with  the  priiuiples  el'  tr.iiniiii;  feiiiul 
te  he  impert.int  in  the  Army's  researeh  effert  s in  siippert  ef  the 
KI  Al.fKAlN  prenr.iiii.  I'hese  prinviples  st.ite  th.it  fer  effert  ive 
training:  tl)  the  rues  eiueiint  ereil  hy  t iie  trainee  sheiiKl  reseiiihle 

these  that  .u'tii.illy  evviir  en  the  leh  whivh  elirit  vritiral  he 
h.iviers;  aiul  (J)  the  trainees  sluniUI  he  able  te  respeiul  in  tr.iiiiiiiy; 
as  they  will  he  reipiireil  te  respeiul  en  the  jeh. 

I'hreal  ilat.i  analysis  .nul  leiiihat  perferm.inee  ileteriiiinat  ieii  fer  MU', 

I'DW  .Hill  l'r.i>;en  starteil  with  a review  ef  literature  aiul  ^■ens||l  t .it  ien 
with  experts  te  ilet  e run  ne  smtahle  p.ir.imeters  within  wliiiii  te  ile- 
fiiie  the  leiiihat  erieiiteil  threat  sitiiatieiis  fer  use  in  t lie  .iiialvsis. 
.Siiue  rues  aiul  respenses  were  essential,  the  p.ir.imeters  feiiiseil 
prim.irily  en  what  the  iiiiliviilii.il  II. .S.  selilier  er  erew  weiiM  he 
likely  te  see  (what  raiip.e,  wli.it  iiiimhers,  wh.it  ileplei'ini'iit  , what 
t.ir^et  veiif  1 miral  inns  I aiul  wh.it  t In-  thri'al  weiilil  ile  (lypir.il  speeil , 
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t.n.tu's,  I'ti'.l  i>ii  t lu'  mill  iiili'iisny  Niutlurn  l);it  t 1 1'l  i cUl . 

All  J.it.i  Will'  iiviiwi'il  ta  1 1 li  I lit  i' 1 1 i yt.'i"' <■'  mnummiTy  aiul  USA  IS  t.-x|)iTt  s 
.ukI  liii.il  thiiMl  |i.i  iMnut  i- 1'  valiu's  were  Ui’tiiii-U  a'<  sliuwii  in  tin-  ni-xt 
tliiiH-  -.lull'-..  (SI  lUl  J Mlt,  rilKlAI  l'At(/\Ml  11  KS)  (Sl.llil,  A aiul  A 
urn  arul  DKACDN  1111(1  AT  I’AKAMMI  KS  1 . 

It  t lu'  I lit  lilt  I I'll  III'  till'  '.tiiilii'.  Iiail  I'l'iii  rail)’/-  ili'.  ij;ii,  wr  iiii^tit 
flail-  sti'ppi-il  lull-.  I 111  i-  thi'si-  laliii.--^  ik-tini.-  t tii-  paraiiu-t  its  fur 
I in.- 1 ns  1 nil  m raii^i-  i on  IT  pii  ra  t i nils  wtiiili  an-  liki-ly  to  load  to 
i-t't'i-it  1 1 1-  tiaiistiT  ol'  traininy.  troiii  r.niyo  to  bat  t 1 of  iold.  Onr 
intont,  lioivovor,  was  n-ali-itio  iraininy  oritoria  wtiioli  moans 
-•tand.irds  of  po rfo niiaiioo  as  woll  as  oonditions  nndi-r  wtiioh  to  tram 
,ind  tost.  ITii-  standards  li.ul  to  bo  siuli  that,  if  attainod,  t ho 
individu.il  vould  bo  i-xpoitod  to  survivo  .mil  win  on  tlio  I'a  1 1 1 o f i o 1 d . 

In  our  .ippro.ivU  to  this  probloiii,  wo  olioso  two  difforont  stratoyios  -- 
ono  tor  t lio  Mill  and  .inothor  for  I'DW  .iiul  I'rayon.  Ibo  uso  of  two 
slr.itoyios  was  nooossitatod  boo.iuso  vombat  d.ita  oxistod  for  riflo 
I 1 fi- . but  nono  for  TOIV  aiul  Urayon.  Wo  b.isod  our  analysis  for  t ho 
Mil'  on  liorothy  t!l.irk's  "broakpoint  thoory"  in  whioh  it  is  hyi'ot  bos  i :od 
th.it  .It  '.ort.iiii  oasii.ilti  lovols,  a unit  will  try  to  broak  off  .in 
ony.iyomont  . or  at  loast  will  oh.inyo  to  .i  dofonsivo  position.  I'ho 
b.isio  d.ita  for  broakpoint  .inalv-;is  is  shown  in  tho  followiny  slido 
from  Uorothv  Clark's  IdS-l  study.-’  (Sl.lUl  .b  - HKbAKI’0 1 .NT  (llbM’Ml 
A oommont  is  important  horo.  first  wo  aro  awaro  of  oritioism  of 
thoso  dat.i,  with  roy.ird  to  oortain  assumptions  about  tlio  probabilistic 
n.itiiro  of  commando  r ' s docision  makiny  and  tho  rolo  typical  Iv  played 
by  such  factors  as  motivation,  Usulorship  .iiid  societal  variables  in 
iiKulifyiny  tiu-  bohavior  of  units  iindor  pressure.  Wo  aro  also  unawaro, 
howovor,  of  anv  bettor  study  done  to  update  Clark's.  Wo  did  ipiory 
commanders  on  their  expectation  of  troop  performance.  The  moan 
broakpoint  chosen  by  commanders  was  a .nO  casualty  fraction  which 
falls  .it  tho  1>11  pi-rcont  jirohabi  1 i t >■  of  broakiny  on  tho  curves. 

file  next  task  was  to  uso  tho  threat  parameter  data  and  tho  estimated 
niimlu'i-  of  casualties  to  deduce  what  an  individual  would  have  to 
contribute  to  casualties  if  ho  operated  in  a squad  context.  Usiny 
.1  .'5  man  attacking  unit  at  least  KS  casualties  (blTk)  would  have 
to  bo  attainod.  Unit  commanders  with  combat  experience  were 
given  scenario  descriptions  and  asked  to  state  tho  desired  perfor- 
mance levels  of  troops  in  terms  of  rounds  per  hit  per  range  band. 

Uver  d.SO  unit  conmianders  wore  questioned  ;ind  that  data  used  together 
with  breakpoint  data  to  est.iblish  minimum  acceptable  standards  ex- 
pressed in  terms  of  number  of  hits  to  be  achieved  in  training,  given 
a siiec  i f i e a 1 locat  i on  o f ammun  i t i on  . 


(Mark,  I'orothy;  tlaji^ujil  t i es  as  a Measure  of  the  Toss  of  Combat 
If  feet  iveness  of  an  Infantrv  Battalion:  d.Sil , August  iil.S.t. 
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I'he  row  ail  I Ora^oii  rcproseiit  oil  a ilirCoroiit  situation  than  Jid  tho 
MU)  for  setting  traininj*  standards,  first  of  all,  both  weapons 
have,  by  design,  hi^h  first  round  hit  prohahility  if  properly  used 
since  both  are  wi  re-jjuided,  optically  tracked  systems  eroployinj: 
a sinhtiiiK  system  that  reipiires  merely  that  the  jjunner  kee|>  the 
ciDsshairs  on  the  si^ht  aligned  with  the  target  during  the  missile 
flight  time  in  order  to  achieve  a hit.  Whereas,  the  rifle  is  de- 
signed to  be  multishot  weapon,  ant ianmir  weapons  must  achieve  high 
first  round  hit  probabilities  in  order  to  allow  crew  survival  be- 
cause of  the  extreme  firing  situature  of  the  weapon  which  makes 
detection  of  the  weapon's  position  relatively  easy.  Second,  very 
little  live- fire  data  from  combat  or  training  exist  for  either  the 
row  or  the  Dragon.  As  was  the  case  with  the  Mlh  study,  coimiianders' 
expectations  were  determined,  but  here  they  were  used  to  see  if 
ilifferences  existed  between  doctrine  and  commanders'  expectations. 
I'his  was  done  as  a guide  to  improving  the  management  of  training 
by  correcting  misconceptions  about  weapon  performance  or  target 
behavior. 

Since  live  fire  data  were  at  best  very  sketchy  for  fOW  and  Dragon, 
recommended  training  staiulards  had  to  be  deduced  from  three 
sources  of  information.  first,  since  the  weapon  is  a guided  weapon, 
simulations  could  be  rim  that  supiiorted  the  contention  that  high 
hit  probabilities  were  possible  with  proficient  crews.  Next,  train- 
ing device  scores  did  indicate  that  some  trainees  couKI  achieve 
high  training  device  scores  which,  (assuming  relationships  between 
training  device  scores  and  live  fire  proficiency  1 would  support 
the  simulations.  finally,  .in  independent  human  factors  analysis 
indicated  that  no  reipiired  psychological  or  motor  tasks  were 
beyond  the  capabilities  of  the  average  trainee,  (liven  these  three 
pieces  of  convergent  data  it  was  concluded  that  high  simulated  hit 
probability  values  could  probably  be  attained  in  training,  and 
values  were  set  accordingly. 

('liven  the  st.indards  and  conditions  needed  to  demonstrate  that  train- 
ing had  been  effective,  it  was  necessary  to  determine  the  training 
setting  to  be  recommended.  I'hat  setting  was  to  include  the  physical 
design  of  r.inges , devices  or  eipiipment  needed,  the  target  scenarios 
necessary,  and  the  nature  and  seipience  of  trainee  tasks.  In  defin- 
ing our  recommended  program  we  used  the  basic  premise  that,  with 
respect  to  training  setting,  the  most  effective  training  results 
from  actual  hands-on  experience  in  an  o|)erational  setting.  Such 
realism  is  often  limited,  however,  by  cost  .iiul  s.ifety  considerations 
It  w.is  necessary  to  identifi  tr.ule-offs  with  full  realism  either  in 
terms  of  tr. lining  strategies  or  devices  that  offered  high  degrees 
of  traiist'er  of  training.  for  the  Ml(),  transfer  of  training  studies 
for  two  individual  tr. lining  devices,  lASlU'l  RA 1 N and  W1  Al’dNl  f.R ; and 
Mills  for  sipiad  training  are  currently  being  conducted  or  planned. 
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In  the  case  of  the  Mlh,  we  recommended  a series  of  live  fire  and 
enjiajjement  simulation  exercises  on  ranges  that  are  as  realistic 
as  the  state  of  the  art  allows.  We  then  recommended  that  when 
transfer  of  training  data  are  available,  devices  he  substituted  to 
the  extent  that  high  transfer  of  training  and  cost  reduction  couM 
he  demonstrated. 

for  the  TOW  and  Dragon,  we  were  again  confronted  by  a situation 
in  which  emjiirical  data  on  live  fire  effectiveness  or  device 
effectiveness  neither  exist  nor  could  be  expected  to  be  obtained 
in  the  immediate  future.  Moreover,  we  could  not  realistically 
expect  live  fire  during  training  because  of  the  high  cost  of  live 
ammunition.  The  problem  was  one  of  designine  an  effective  al- 
ternative to  live  firing  in  a situation  where  live  fire  experimen- 
tation to  document  transfer  of  training  could  not  be  conducted. 

I'o  do  this  we  chose  an  analysis  procedure  called  TRAINVICU.  The 
rRMNVlCi;  model  was  developed  by  Wheaton  e t . a 1 (197(i)  for  AR! . ^ 

It  compares  a training  device  with  operat ional  equipment  on  three 
dimensions,  task  communality,  physical  fidelity  and  functional 
fidelity.  It  also  considers  the  difficulty  of  a task  and  the 
degree  to  which  the  device  incorporates  proven  princi[)lcs  of  ef- 
fective training.  These  factors  are  treated  in  a quantitative 
expression  that  yields  a figure  of  merit  known  as  tau,  which 
purports  to  be  indicative  of  transfer  of  training  potential.  The 
metric  properties  of  tau  are  not  known.  It  should  therefore,  be 
used  only  as  a relative  value  until  future  research  is  done  to 
validate  the  model.  In  our  study  we  used  TRAINVU'T.  to  analyse 
the  probable  effectiveness  of  several  alternative  training  device 
configurations.  Tor  the  TOW  we  considered  the  M-70  trainer  and 
the  TVT.  Tor  Dragon  we  considered  the  Launch  T.ffects  Trainer  (1.T7T1 
and  the  TV'’!’.  In  both  cases  alternatives  incorporating  the  TV'T  were 
judged  to  be  more  effective.  That  is,  the  alternatives  that  provide 
the  greater  degree  of  feedback  to  the  trainee  were  predicted  to  have 
a higher  transfer  of  training  value.  This  provided  two  useful 
pieces  of  information.  It  allowed  us  to  suggest  program  improve- 
ments given  current  techniques  as  well  as  to  suggest  planned  evolution 
of  devices  and  techniques  to  iecorjiorate  features  that  would  be 
expected  to  enhance  training  effectiveness. 

At  this  point  in  the  analysis  we  had  considered  training  criteria, 
devices  and  techniques  which  could  be  expected  to  constitute  an 
effective  training  environment.  It  now  remained  to  put  these  together 
into  a recommended  program  that  stated  what  strategies  should  be 
used  and  what  resources  itime,  ammunition,  facilities)  were  necessary 
to  increase  the  probability  that  trainees  would  attain  the  desired 
standards  when  asked  to  perform  under  realistic  conditions.  That  is. 


‘^Weaton,  ll.  R.  ; Tingcrman,  I’.  W.  ; Rose,  A,  M.  ; and  Leonard,  R.  L.  Ir; 
lival  nation  of  the  Tffect  i veness  of  Jr;n  njj'S^  br'.' j 
and  Application  of  the  Prediej^e  Nlodel  , Researcji  Memorandum  ''('-1(>, 
The  II. S,  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences;  .hily  197(i. 
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It  Is  not  sut  t ic  ifi>t  to  ixposo  tho  iraiiu'o  to  repoatod  realistic 
ovoiits  with  livo  fi  ro  or  et't'octivo  simulation.  Stratogics  must  bo 
dovolo|)od  that  (irovido  a liijjh  probability  of  loaniiun.  Wo  used 
throe  stops  for  tlio  Mlt),  TOW  and  Hra^on. 

Wo  first  oonductod  a human  faotors  aii.il\'-i'.  of  oaoh  woa|)oti  system 
to  dotormino  the  skills  .ind  knowledges  required  for  weapon  system 
operation,  .\e.xt  , we  reviewed  available  diagnostie  data  in  an 
attempt  to  determine  what  errors  of  performaiiee  were  persisting 
111  spite  of  eurrent  training  proeedures.  linally  we  ajiplied  .1  set  of 
principles  th.it  R1  Al.TRXlN  research  has  shown  to  be  effective  in 
training  progr.im  design  to  wit; 

(I)  I'he  individual  must  be  a participant  in  training,  not 
an  observer. 

(J)  rhe  cues  in  tr.iining  should  resemble  those  that  occur 
on  the  job  to  elicit  critical  behaviors. 

(A)  The  ''r.iinee  should  be  able  to  respond  in  training  as  he 
would  in  combat. 

i-l)  The  trainee  should  receive  immediate  feedback  in  that 
situations  change  as  the  individual  responds. 

(.S)  Training  should  be  structured  to  eliminate  specific 

performance  errors  in  .1  sequence  that  builds  on  previous 
t ra  i n i ng . 

(t>l  Whole  task  performance  should  be  evaluated  in  a post- 
training session. 

In  retrospect,  I'll  admit  that  the  second  step,  the  definition  and 
.inalysis  of  common,  recurrent  errors,  intuitively  appealing  as  it 
sounded,  was  not  useful  since  good  diagnostic  systems  do  not  exist 
for  the  Mlt),  and  the  value  of  the  diagnostic  data  available  for  TOW' 
and  I'ragon  can't  be  determined  without  live  fire  data. 

('liven  these  analyses  we  were  able  to  recommend  training  programs 
for  Mlt),  row,  I'ragon  and  outline  those  further  tests  necessary  to 
validate  standards,  conditions  and  the  actual  effectiveness  of 
recommended  programs.  A suinraary  of  our  recommendations  are  shown 
on  the  next  two  slides  (Sl.IDi;  b - Mlb  RliOONMiNl'ATlONS , SLlDi;  7 - 
row  AND  I'lbtCON  Rht.'OMMhNDATIONS)  . 

I'o  summarise  our  effort,  let  me  return  to  the  first  slide.  (.Sl.ll'l; 

8 - BASIC  S'l'lll'Y  l.OCU'l . Using  threat  data  and  operator  task 
requirements  we  postulated  the  standards  to  be  met  by  the  trained 
weapons  ojierator  and  the  conditions  under  which  he  should  he 
trained  and  tested.  We  then  used  constraints  to  a fully  realistic 


814 


training  sotting;  to  ilot'iiu-  traiuiiij;  ilov  i (.f  romu  romont  s and 

loal  data  or  a p rod  i rt  i vo  moilol  to  wliiih  dovioes  to  employ. 

I he  tr.il  111  iiy  strategies  to  l>e  used  were  recommended  based  on 
.issessmi'iit  s of  oper.itor  psvcIionKit  or  capabilities  and  the  effectiv'e- 
ness  ol'  some  basic  training  strategies. 

I be  implication  of  this  j;eneral  approach  for  future  tr.iininfi  resource 
prediction  became  .ipparent  when  we  realised  tliat  our  total  analyses 
b.id  been  dependent  on  five  factors. 

• Threat  statements 

• Weapon  system  operator  reipi i remeiit  s 

• i.'ost  , safety,  or  st.ite  of  the  .art  limitations  on  live  firing; 
or  training  realism. 

• Proven  or  theoretical  effectiveness  of  training  strategies. 

• Operator  [isycbomotor  capabilities. 

Use  of  our  >;eneral  approach  for  any  weapon  system  is  dependent  on 
knowledi;e  of  the  status  of  those  five  factors  for  the  weapon  system 
in  question  at  the  time  the  weapon  system  of  interest  is  to  be 
deployed.  For  three  of  the  factors  intelligent  guesses  can  be  made 
for  trends  for  the  near  time  frame,  say  1985'1995.  .Specifically, 
threat  force  capabilities  can  be  projected  given  the  current  pattern 
of  weapon  system  evolution,  the  state  of  technology  and  evolving 
threat  force  doctrine  developments  . Weapon  system  operator  re- 
quirements can  be  estimated  by  noting  trends  in  the  family  of  weapons 
of  which  the  future  weapon  system  is  a member  and  a review  of  the 
state  of  the  art  in  our  own  wea]H)n  system  technology.  Future  con- 
straints are  jirobably  the  easiest  to  postulate  since  they  will 
undoubtedly  include  less  land  for  maneuver,  less  live  ammunition, 
more  severe  environmental  impact  constraints  and  no  relaxation  in 
safety  considerations.  Trends  in  operator  psychomotor  capabilities 
are  less  easily  predicted  than  in  the  case  of  the  first  three  factors, 
however,  for  the  time  frame  of  interest,  namely  now  to  199.S,  I doubt 
we  will  see  dramatic  changes  in  miaided  human  capabilities  although 
we  may  see  technology  replacing  operator  tasks.  With  respect  to 
future  training  strategies  and  their  effectiveness,  trends  cannot  be 
projected.  However,  we  can  assume  that  those  strategies  currently 
held  to  be  effective  will  not  subsequently  be  proven  ineffective 
but  rather  will  be  improved  iqion.  In  that  case,  projections  about 
effective  future  training  and  the  resources  required  to  implement 
those  programs  will  be  conservative  estimates  subject  to  revision 
as  new  training  strategies  are  developed. 

1 do  acknowledge  that  our  ability  to  forecast  threat  trends  and 
resources  constraints  is  limited  and  diminishes  as  a function  of  just 
how  far  into  the  future  we  look.  Nkireover,  since  human  factors 
considerations  and  operator  requi  remi'nt  s statements  for  new  weapon 
systems  are  typically  post  hoc,  we  seldom  have  a clear  picture  of  the 
man  side  of  the  man-machine  system  until  after  prototypes  are  fielded. 
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rhoso  say  only  that  the  estimation  of  training  jiroKram  and  device 
needs  for  future  systems  must  he  iterative  and  approximate.  We 
can  jjuesstimate  nevs  threats,  operator  tasks,  resource  restr.iints, 
and  technological  compens.it  ion  for  operator  limitations  for  .iiiy 
system  and  thus  approximate  the  tr.xining  system  needs.  The 
documented  guesses  and  assumptions  v»e  h.ive  to  make  at  time  zero 
form  the  basis  for  guiding  d.ita  collection  at  subsequent  steps 
during  the  evolution  of  the  weapon  from  concept  to  fielded  svstem. 

In  summary,  Mel  Ionics  has  defined  a procedure  for  doing  training 
effective  analyses  based  on  certain  data  renuirements  and  a set 
of  explicit  .issumpt  ions  about  the  nature  of  effective  tr.iining 
and  the  process  of  transfer  of  training.  The  application  le.ids 
to  a st.itenKMit  of  training  programs  whose  .ictual  effectiveness 
IS  verifiable.  The  extension  of  that  nxidel  to  the  future,  is 
however,  the  nxire  interesting  since,  1 believe  we  liave  defined 
certain  sets  of  data  requirements  and  logical  processes  bv  which 
tr.iining  pl.inners  can  work  in  parallel  with  training  weapon  svstem 
developers  to  evolve  effective  training  programs.  Moreover,  1 
believe  we  have  defined  processes  by  which  intelligent,  defensible 
est  invites  of  future  training  resource  requi  rerntMits  can  be  m.ide. 
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Pr.  '"Ihtc'wis  ,I.  ".'ionii'V,  Pi  . 

Dr.  Pol'n  A.  Partjioi  , 

I'.D  Antis’  IntanliA'  Selim  1 
Aniis’  Di'.siMreh  Instituto 

M’^'.nvVr;  'Ifie  punxiso  ot  Inl  ant  lA'  u'lMixins  (o.a.  , MKiAl  l-’itlo)  i.s  to 
onis’iao  the  Infant  lA'  soUiior  the  eaixiltility  of  del  ivi-rina  tJu-  ts^x'  am) 
volutio  of  tils'  noitessaiA’  for  thi'  s.uetA's.st  ul  o.xtvufion  of  tlu'  varioiL'i 
iiuiiviikuil  and  la'sill  unit  iMuJ-at  ai’t  ions,  wliioh,  ixins.idonxl  eol  h'ot  is't'ly , 
i.xx'ipris.i'  the  mission  ot  tlio  Inlantis’. 

'dll'  aoal  I't  tJu-  iVit.il  Kiflo  '1.11  ks.i'.kinshii)  'I'laininD  ;'.\'stini  is  to  pixxiueo 
a sAxiilxit  s't  tos't  ive  ritUiain  (min-ss'i'.  i[xin  sys.toi'i)  v.’ithin  ciis'on  trainimi 
ri'sounx'  iMnstraints.  iiu'  tw'  di  is’ina  loiax's  of  this  tiystoiii  cU'siiin  are 
Uk'  ixist  ('f fivtivonoss.  of  ins’i's.tiix'nt s.  in  tiainina  (tlio  Cost  and  i'lainiini 
i:f  fstet  ivi'Jk'ss  Analysis  pnx'os.s)  .mil  thi'  nxpii nxtx'iit s of  the  Uitt  li>-f iold 
(Uio  tlu'Oiit  iMivi ronitx'jit) . 'Ifie  pi  iiiuiry  olijix’tis'o  of  thi;;  ivi[x'i'  will  Ix' 
to  bluopi  rnt  tJio  intorrolat  ioasliip  esf  tlu'so  tsAi  fon-o;:  and  flu'ir 
individual/eol  loot  ivo  eontrihut  ion  to  inero.isinci  thi'  (xitontial  ('ffix-t  ivo- 
nos;;  of  Uio  rifloiivui  on  tlio  battlofiold. 

The  woaixin  is  only  one  anixMk'nt  of  tlio  total  iiwiri-wi'.iixin  ss’stixii.  'itiis 
sysLtaii  must  lx.'  i'valu.ittxi  in  relation  to  tlu'  total  I'livironi.x'jit.il  ixmti'.vt 
in  which  it  is  to  Ix'  ilsixI.  'Ihoix'foro,  tJio  first  stoii  will  Ix'  ti'  define 
Uie  miux'ptaul  .uid  o|x'rational  thre..it.  'llie  ne.xt  steji  will  Ix'  ti'  dismiss 
in  :;aix'  deUiil  hexv  the  to(>-Aiixvn  (inxx's.s  of  tlie  Cost  and  Traininq 
bffLK'tivoni'Ss  Aikilysis  is  usixl  to  cstaldish  the  ta.sks,  ixinditions,  .uxl 
standanls  at  succe.ssively  n'fimxl  dixmx'S  of  detail  (e.q.,  puty, 

task.-  .md  oleiix'nt).  'Ihis  discussion  will  al.so  illustxatt'  tJie  luxxi  for 
fiold  tests  to  ixurirical ly  validate  thi'  mnt.ribut  ions  of  traininq 
innovations,  'nie  liasic  lUfle  ftirksiitinship  'I\'st,  and  l.i.ser  'Ufle/dtim- 
tire  .Adaptor  Test,  and  the  lik'atxmix'r./Iasert  rain  (Dia.inxist  ic  Itifle 
Marksniiuishi p Simiilator.s)  'Iir-st  will  Ix'  u.sixl  a.s  t'Xiiiii|)les  of  field  ti'sts 
of  traininci  systems.  In  addition,  these  tests  and  otJii'rs  will  U'  ustxl 
to  demonstrate  the  stnaKiths  and  short -cAxiiinqs  of  de;;iiininq  field  tests. 
Ilnphasis  will  Ije  plaaxl  on  test  desiqji  issues  such  as  'V;a;;iues  of  bfft'c- 
tiveness,  use  of  projx'r  control  qroups,  sul'iect  .s.amilinq,  qu.il  it\'  ixsntxol 
in  data  collection  and  rfxluction,  .mil  exjxir irxait.il  ('ontnil . llxain'les 
will  be  used  to  illastrato  hev'  errors  in  tent  deniem  and  test  e.xixnitiiai 
fretfuently  lead  to  results  of  "no  difference's"  aixl  ina[>iiropriate  ixm- 
clusions  of  "fxpjal"  treatiixait  effects. 

In  conclusion,  the  IVital  Ilifle  fUirksnxinship  'I'laininq  Kystini  will  Ix'  iisixi 
to  bring  all  of  the  previous  disciussions  into  fix’us  - CUxirations  ik'search 
Support  of  the  Army  in  tlio  80 's. 
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AliSTKAL'T 


rills  p.iper  presents  the  results  ol  applying  Operations  Keseareh 
methodology  to  V Oorps'  Major  Train. ag  Area  Operations  in  the  Federal 
Rep'il’lii'  “f  Oermanv.  The  stndv  eovers  three  .aspects  ot  these  M'TA  oper.i- 
tions:  the  movenu'iU  ot  tracked  vehicles  to  training  sites,  the  predic- 

tion .nul  .il  location  ot  supply  costs  .issociated  with  MTA's  .and  the  sched- 
uling I'f  MTA  operations.  The  prim.iry  focus  of  this  paper  is  on  the  com- 
puter-assisted scheduling  system  whiih  has  been  developed  to  .aid  V Corps' 
0- i Section  in  its  development  ot  the  Corps'  training  program.  The  dis- 
cussion includes  a description  of  the  sclu’duling  system  .and  a tlemonstra- 
tion  ot  its  c.apab  i 1 i t i es . Tlu'  ti'pics  ol  rail  movenuait  and  supply  cc'sts 
.ire  .iddressed  hriellv,  outlining  the  analysis  in  these  are. is.  The  com- 
plete .inalysis  of  the  three  topics  is  cont. lined  in  a Naval  Dost  grailuat  e 
School  report. 
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Operations  Research  at  the  Corps  Level:  An  Analysis  of  V Corps  Major 

Training  Area  Operations 

by 

Dr.  Samuel  H.  Parry,  CPT  Mictiael  J.  Moore,  USA,  CP7'  Thomas  J.  Teesdale,  USA 

Naval  Postgraduate  School 
Monterey,  California 


1.  INTRODUCTION 

The  Dictionary  of  the  United  States  Army  Terms  (AR  320-5)  defines 
operations  research  as:  "The  analytical  study  of  military  problems,  under- 
taken to  provide  responsible  commanders  and  staff  agencies  wltli  a scien- 
tific basis  for  decision  on  action  to  improve  military  operations."  In 
the  spirit  of  this  definition  the  autliors  undertook  an  analysis  of  Major 
Training  Area  Operations  In  V Corps,  USARKUR  and  addressed  problems  in 
tills  area  of  concern  to  the  Corps  Commander  and  his  staff.  This  appli- 
cation of  operations  research  resulted  in  a computer  assisted  system  of 
scheduling  MTA  operations.  In  addition,  the  study  systematically  sets 
forth  MTA  movement  costs  and  aspects  of  MTA  supply  costs  for  consideration 
by  the  commander  in  his  decision-making  process.  Tills  paper  briefly  dis- 
cusses the  analysis  performed  with  regard  to  movement  and  supply  costs 
and  concentrates  on  describing  the  computer  assisted  scheduling  system 
and  users  guide  which  has  been  forwarded  to  V Corps  for  use  by  the  C-3 
training  section. 


II.  STATEMENT  OF  THE  PROBLEM 

A.  V Ci'rps  conduits  bat  t a 1 i on-s  1 7,i’d  training  exercises  at  four  major 
training  areas  (MTAV:)  . All  battalion-sized  combat  elements  participate 
and  perform  gunnery,  maneuvers,  and  ARTEP's  during  MTA  operations.  The 
management  of  these  training  activities  is  a monumental  task  for  the  fol- 
lowing reasons: 

1.  V Corps  competes  with  other  USARFUR  and  allied  units  for  the 
use  of  MTA.  This  fact,  combined  with  the  desires  of  V Corps'  unit  com- 
manders, creates  a year  long  scheduling  exercise  iicfore  the  following 
year's  program  is  finalized. 

2.  V Corps  must  budget  for  these  activities  in  separate  cate- 
gories as  follows: 

Class  II  - Personal /Administrat ive  Supplies  and 
Organizational  Tools 

Class  III  - Petroleum  Products 

Class  IV  - Construction  Materiel 

Class  IX  - Repair  Parts  for  Equipment. 

3.  Funds  must  be  properly  allocated  to  each  unit  based  on  antic- 
ipated training. 
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III.  OBJECTIVES  OF  THE  ANALYSIS 


In  view  of  the  above  situation  the  objective  of  the  analysis  was  to 
provide  V Corps  with  readily  implementable  methodologies  for  accomplishing 
the  following: 

A.  Increasing  combat  training  within  the  constraints  imposed  by  the 
rail  movement  budget; 

B.  Accurately  predicting  supply  costs  of  MTA's; 

C.  Reducing  the  burden  of  tlie  manual  scheduling  system. 

The  realization  of  these  objectives  required  the  quantification  of 
supply  costs  of  specific  training  events  in  terms  of  Classes  II,  III,  IV, 
IX  and  rail  transportation.  In  addition,  construction  of  a computer  based 
model  capable  of  handling  the  real  world  constraints  was  necessary. 


IV.  OVERVIEW  OF  ANALYSIS 

A.  The  quantification  of  training  costs  in  terms  of  Classes  II,  III, 
and  IV  were  feasible  and  V Corps  was  predicting  and  allocating  these  costs 
by  training  event.  This  allocation  was  accomplished  through  battalion 
training  matrices  and  cost  factors.  The  accuracy  of  these  costs  was  not 
suspect,  assuming  good  estimates  for  expected  vehicle  mileage  during  the 
training  exercise. 

Class  IX  costs  were  much  more  elusive.  The  Corps  was  using  cost 
factors  provided  by  the  Department  of  the  Army.  They  were  incorporated 
into  the  battalion  training  matrices  and  provided  what  was  felt  to  be  the 
best  available  cost  predictions.  Howi ver,  the  DA  cost  factors  were  highly 
prone  to  error.  In  June  1977  V Corps  was  in  the  process  of  collecting 
data  for  the  development  of  their  own  cost  factors. 

Basically,  these  cost  factors  are  averages  and  are  in  terms  of 
dollars  per  mile.  Due  to  their  large  variance,  even  accurate  cost  factors 
can  grossly  miscalculate  the  actual  cost  of  a training  event.  Using 
results  from  a Research  Analysis  Corporation  study  [1]  and  the  results  of 
data  collected  by  the  authors  in  June  1977,  an  alternative  methodology 
was  developed.  The  new  technique  essentially  entailed  the  management  of 
selected  vehicle  components  at  a level  higher  than  battalion,  thereby 
eliminating  some  of  the  variance  at  the  battalion  level.  The  remaining 
Class  IX  items  would  be  managed  at  the  battalion  level  and  costs  for  spe- 
cific training  events  better  predicted. 

B.  Rail  Movement  costs  were  quantifiable,  but  required  extensive 
calculations  before  one  could  acquire  a projection  for  a specific  move- 
ment. This  hindered  effective  management  by  commanders  when  they  were 
evaluating  alternative  training  sites,  vehicle  mixes,  and  substitute 
modes  of  transportation  such  as  heavy  equipment  transporters  or  road 
marching.  Using  the  rate  scales  and  vehicle  characteristics,  the  authors 
generated  cost  tables  listing  the  rail  shipment  costs  from  garrison  loca- 
tions to  training  sites  for  individual  vehicles  and  the  100%  TOE 
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laimplfmint  of  armor,  artillery,  meehanized  infantry  and  armored  cavalry 
bat  ta  1 ions/sqiiadrons  . These  tables  provide  a usable  management  tool  for 
commanders  attempting  to  select  the  optimal  mode  of  transportation. 

C.  The  computer  based  scheduling  model  was  feasible,  based  on  tin 
following  concepts; 

1.  Commanders  determine  their  unit's  training  requirements 
basid  on  military  judgment; 

2.  Commanders  determine  a desirable  unit  schedule  and  in  the 
process,  minimize  rail  movement  costs  for  their  unit  using  the  cost 
tables;  and 

3.  The  Corps  training  schedule  is  then  generated  with  the  help 
ot  a computer  based  scheduling  model. 

This  approach  leaves  the  determination  of  what  is  the  best  train- 
ing mix  up  to  the  subjective  judgment  of  the  commanders. 

V.  THE  COMPUTER  ASSISTED  MAJOR  TRAINING  AREA  SCHEDULING  SYSTEM  BACKGROUND 

The  North  Atlantic  Treaty  Organization  has  established  a series  of 
twenty  Major  Training  Areas  (ffTA)  throughout  the  Federal  Republic  of  Ger- 
many. With  few  exceptions,  the  elements  of  V Corps,  U.S.  Army  Europe, 
conduct  their  MTA  operations  at  the  following  locations:  Baumliolder , 
Grafenwoehr,  Hohenfels,  and  Wildflecken.  Traditionally,  a manual  sched- 
uling system  has  been  employed  to  coordinate  the  use  ot  these  facilities. 
This  system  requires  an  extensive  man-hour  commitment  which  is  dominated 
by  the  requirement  to  check  and  cross-check  authorized  allocations  against 
existing  schedule  commitments  and  new  requests.  The  actual  extent  of  this 
effort  might  be  better  illustrated  by  the  fact  that  V Corps  must  be  capa- 
ble of  scheduling  sixty-four  individual  battalions  into  these  four  MTA's 
each  year,  and  that  many  of  these  battalions  must  be  scheduled  two  or 
three  times  in  order  to  participate  in  different  types  of  training. 

Also,  the  scheduling  process  must  be  a dynamic  system  which  is  capable 
of  preparing  an  initial  schedule  and  of  processing  numerous  changes  dur- 
ing the  entire  year.  In  short,  the  manual  scheduling  process  is  a tedious, 
time  consuming  effort  which  is  extremely  vulnerable  to  oversight  and 
error . 

The  requirement  to  develop  and  manage  an  annual  MTA  schedule  combines 
the  results  of  two  types  of  decisions  to  produce  a final  product.  The 
first  of  these  decision  processes  drives  the  schedule  to  accomplish  its 
ultimate  goal  of  providing  the  necessary  training  to  maintain  the  combat 
readiness  of  all  V Corps  elements.  This  type  of  decision  includes  pro- 
viding adequate  priorities  to  the  proper  units,  insuring  that  an 
assigned  training  area  satisfies  the  requirements  generated  by  a particu- 
lar type  of  training,  and  insuring  that  training  is  scheduled  at  a time 
which  logically  coincides  with  each  battalion  training  program.  These 
decisions  are  critical  to  management  and  depend  on  an  understanding  of  the 
unique  situation  of  each  unit.  The  second  type  of  decision  involved  in 
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nutnaglnK  tt**"  MTA  schedulo  Is  the  static  decision  generated  by  the  plivsical 
constraints  of  eacli  MTA  and  by  tlie  constraints  Imposed  by  higher  head- 
quarters. Ttiese  decisions  insure  tliat  training  is  scheduled  onlv  during 
authorized  time  periods,  that  density  constraints  for  all  training  areas 
during  all  periods  are  satisfied,  and  that  schedule  information  is  dis- 
seminated to  all  appropriate  elements.  Hensity  constraints  designate  the 
nuximum  numlier  of  battalion-sized  elements  that  may  occupy  an  MTA  at  any 
one  time.  These  decisions  are  constrained  and  tedious,  but  are  necessary 
to  insure  the  lievelopment  of  a feasible  schedule. 

A situ.ition  such  as  the  one  described  above  can  be  effectively  and 
efficiently  m.inaged  by  employing  a computer-assisted  scheduling  system 
which  sep.irates  the  two  types  of  decisions  involved  in  developing  the  MTA 
schedule.  Tl\e  computer-assisted  system  requires  the  nuinager  to  make  the 
critical  management  decisions  and  employs  a computer  to  resolve  the  con- 
strained decisions,  to  consolidate  all  schedule  inf  ornuit  ion , and  to  pro- 
cess this  information  in  a useful  format. 

Des  c r i pt  ion  of  t he  Computer-Assisted  Scheduling  Sy  s_t  em 

The  computer-assisted  scheduling  system  designed  for  V Corps  follows 
the  basic  methodology  used  by  the  V Corps  C-3  Section  to  nutnual  ly  prepare 
the  MTA  scliedule;  however,  specific  modifications  allow  for  comnuter 
assistance  in  tlie  scheduling  process.  Once  the  initial  MTA  allocations 
are  received  from  USAREllK,  V Corps  must  prepare  this  infornvitlon  for  dls- 
semin.it  ion  to  its  subordinate  major  lieadquarters . Tlie  computer  assisted 
svstem  requires  that  this  preparation  Include  the  c l.iss  if  icat  ion  of  each 
I alloc.it  ion  into  one  of  six  training  categories  and  the  division  of  all 

.iv.i  i l.ib  i 1 1 ty  dates  into  specific  training  periods.  Tlie  six  training 
c.itegories  are  as  follows: 


a . 

tank  qu.i  1 i f icat  ion 

gunnery,  level  one 

b. 

tank  qualification 

gunnery , 1 eve  1 t wo 

we.ipons  firing; 

d. 

■irt  1 1 lerv  firing; 

o , 

maneuver  training; 

and , 

f . 

support . 

Hie  length  of  time  required  to  accomplish  each  type  of  tr-ining  can  be  used 
to  divide  the  aggreg.ite  allocation  periods  assigned  bv  I'SrtEl'R  into  a list 
of  specific  tr.iining  periods. 

With  the  int  I'lm.it  ion  provided  by  the  V Corps  training  section,  each 
he.ulqu.irt ers  c.in  plan  its  MTA  training  and  submit  the  necessary  training 
requests.  Each  rci|uest  must  follow  a format  which  will  permit  the  trans- 
ter  of  this  information  to  the  scheduling  progr.am.  Therefore  each  request 
must  iiu'lude  the  following  information: 

.1 . un  i t des  i gna  I ion ; 

h.  n,i)or  he.idquarters  (8th  10,  3rd  AO,  etc.); 
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0 . 

t 

typo  ,'t 

( r V , 

ot,' . > ; 

d. 

t hf 

tvp<'  of 

c atf 

'g,'r  iosi  ; 

0 . 

l lu* 

pr  i ,'r  i t v 

f . 

l ht* 

t r.i in  i ng 

k- 

t Uo 

dl'llS  1 t V 

h. 

t lU’ 

g.irr  is,'n 

i . 

tlu' 

MTA  r,',|u 

One 

t*  tlu 

■ roiiuost 

i-sii’il  li\ni‘  til,'  six  li.iiiiiiiK 


'r  ir.iiiiinit  at  ,■  suhnii  t t cl  t V I'l'ips  . th,-  task  ,'1 
I’omp 1 1 ittji  ttu’so  roi|iu'Sls  into  a toasibl,'  sohoitnlo  bi'p.ins.  At  this  pi'int 
tlu'  m.iiiagi'ni«'nt  doe  is  ions  hate  Ix'j'ii  roa,),'.  I'lTii',!  numhi'ts  hav,'  hi'on  assip.i'o,! 
t tr.iininp.  datos,  aiul  appi  opr  i.it pr  ior  i t li's  h.iv,'  boon  pivi-n  t >>  t ho  most 
oritioal  training.  Vho  noxt  stop  is  t pionafo  a solu'iliilo  snb),',l  to  t ho 
ilonsitv  constraints  Iroposoil  bv  I'SAKKl'K,  and  to  ,'Vgaui.','  this  scho,lnlo  in 
a format  snitablo  for  d i ssomi  na  t i on  . lliis  I'litii,'  pioooss  can  b,'  ac,om- 
plishod  unicklv  .nut  otliciontlv  bv  tho  V t'orps  I’rogi  ,im  to  si-hi'ilnl,'  MIA 
I'porat  ti'iis . Tho  input  pri'codnri'S  lu'coss.irv  tor  tho  prop,'i  ox,'cnl  ion  ,'l 
tills  program  .iro  ontlinod  in  .1  user's  gni,l>'  wtilcli  is  .in  .ip\'ondix  to 
roforonco  1J|.  flio  progr.im  will  pioduc,-  .1  t,',isihlo  s.hoilnlo  or  idontitv 
ovorschodii  lod  poriiuls  .nul'or  iiulicato  ,'rr,'rs  t ,'und  on  input  o.iids.  TiMin- 
Ing  nvinagors  c.ni  then  ti'quost  .uld  i t i I'li.i  1 donsitios,  .idlnst  tr.iining  pt  ior- 
itios,  or  take  whatovor  .utiv'ii  is  nocoss.iro  to  rosi'lv,'  tho  contliits 
idontiflod  bv  tho  scht'diiling  finitlno.  Onco  tho  input  int  01  m.it  i,'n  Is 
.ul(ustod,  tho  progr.im  c.in  bo  run  .ig.iin  in  .111  ottort  t g.iin  .1  lo.isibl,- 
solution.  I'o  ost.iblish  .in  initi.il  schodulo  this  I'locoss  c.in  b,'  iopo.it  o,i 
.IS  ofton  .IS  ni'coss.irv.  Subsomu'iit  ch.ingi's  m.iv  b,-  m.uio  bv  simplv  .uhling 
or  doloting  tho  .ippropr  i.it  o input  d.it.i. 


T.ip.ib  i 1 i t i os  ot  _Uu'  I'omputot  .Assisted  .''chodii  1 i no.  Svstom 

ITio  scliodiiling  progr.im  provides  the  .ichoduli'i  with  tlin'o  Si-p.n.it,' 
m.in.igomont  .lids.  Kirst,  tho  piogr.im  sc. ins  ,'.ich  input  constr.iint  i.ind 
roc|uost)  ti'f  orri'rs  which  w,'uld  i-.iuso  t lu'  I'logr.im  to  tun,  t ion  i nipt , -per  1 \ . 
When  .in  error  is  toinui,  .1  mi'ss.igo  is  pi  inti'd  which  d,'sci  ib,'s  tho  I'vtoi 
.ind  Idontifios  tho  inv.ilid  input  c.ird.  I'h,'  ,’xocution  ot  tho  I'logi  .im  m.i\ 
or  ni.iv  lu't  bo  t ,'rra  i n.i  t od  , ,lop,'nd  i iig  on  tho  tvp,'  ot  i-ri.n  l.nnui. 


Noxt,  tho  progr.im  provid<'s  .1  summ.irv  ot  the  poi  t iiu'ut  st.it  istics  g,n- 
or.itoil  by  tho  SiTiodulo.  ITn-so  liguii's  .it,'  pi  i'S,'n  t ,',1  bv  m.i)ot  tr.iining 
catog,irv  .nut  porii'il  nnmbor . ligiuo  1 stu'ws  .1  p,M  t i,'n  ,'t  this  siimm.ii  v g,'n- 
or.itod  using  inform.it  i,'n  1 r,'m  th,'  TV  1'*  'g  I'SAKTTK  MT.A  s,-hi'du  i ,- . I'h  i 
ox.impli'  presents  tho  st. it  istics  ,'nl\  tot  tlu-  t.ink  giinnorv  ti.iiiiing  c.ito- 
gorios.  A ot'mplol,'  print, nit  will  slu'w  t h,'  tiguii'S  t,'t  .ill  six  tr.iining 
categories.  ITio  mo.ining  ,’t  tin-  numb, 'is  in  ,'.icli  ,','Iumn  is  ,'vtdi-tu  I t om 
tho  C'liimn  ho.ulings.  One  to.itur,'  ,’l  th,-  svsi,m  is  ,l,'m,'nst  r.it  ,,1  bv  tho 
figures  for  porli'd  twelve  under  t.iuk  guinu'rv,  l,v,'l  tw,'.  N.'t,'  th.il  column 

throe  shi'ws  lu'  units  sclunlii  1 ,',1 ; ,i'lumn  t ,'ut  sluncs  tint  ,'no  ,li'nsilv  i •.  still 
available;  .ind  ciiliimn  I iv,'  stu'ws  ,’ni'  unit  lU't  schoduloil  bi'c.ius,'  ,'1  d,'nsit\ 
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Figure  1 - AN  EXAMPLE  OF  THE  STATISTICS  SUMMARY  PRINTED  BY 
THE  V CORPS  MAJOR  TRAINING  AREA  SCHEDULING  PROGRAM 


1.  iMU.  t iM  i nt . In  this  r.i.si-  till-  oiu’  unit  r>'<|uustin^  training’  .iskuii  for  a 
l.l^•n^-itv  ot  two;  ItowiviT,  on  1 v oin  Jon.sitV  t^as  ant  lior  i ztni  dijriii>>  tills 
pi'fiod.  As  a iisult  tills  unit  was  not  soliodu  1 oil . 

rliis  statist  ioal  sumniarv  is  followod  i'V  a listing  of  tiie  sciieduled 
ttaininj;  and  a listing  ol  t lu‘  tr. lining  wliiili  was  not  .itilo  to  be  seiieduled 
duo  to  training  aro.i  oonstraints.  Tiiose  soliedules  are  available  in  tliree 
separate  torniats  and  tlie  setieiiuler  dietates  wliieii  format  or  group  of  for- 
mats will  be  printi'd.  Hie  formats  are  designed  to  assist  planners  at  vary- 
ing levels  of  the  eliain  ot  ei'nimand . 

Option  OTU'  prints  tlu'  seliedule  separated  by  major  headquarters.  The 
training  is  furtiier  grouped  bv  requesting  unit  designator  and  type  train- 
ing. figure  2 presents  ,in  example  ol  the  seliedule  format  which  is  printed 
using  opt  ii'n  one.  This  figure  lists  the  training  scheduled  for  three 
units  of  the  3rd  .Armor  Division.  Notice  that  in  this  format,  once  a desig- 
nator is  printed,  all  of  the  training  scheduled  for  that  unit  will  be 
listed  regardless  of  training  area.  for  luiclt  .ipproved  training  exercise 
the  sclu'dule  identifies  the  training  are.i,  the  period  during  which  the 
training  will  taki’  place,  the  authorized  unit  density  for  the  training, 
and  the  prioritv  assigned  each  tr.iining  event. 

Option  two  prints  the  schedule  tor  each  major  headquarters  bv  MTA. 
Figure  3 shows  .in  extract  from  a schedule  prepared  using  this  format.  The 
section  of  the  schedule  shown  in  Figure  3 lists  three  units  from  the  8th 
Infantry  Division  with  training  scheduled  at  the  Baumliolder  MTA.  In  this 
format  any  training  scheduled  for  areas  other  than  Baumliolder  will  be 
listed  in  a separate  section  under  the  appropriate  training  area  heading. 
I'he  schedule  information  given  by  this  option  is  identical  to  the  informa- 
tion obtained  from  option  one.  It  is  siraplv  presented  in  a different 
format . 

Option  three  gives  the  scheduled  training  by  MTA  and  type  training, 
regardless  of  major  headquarters.  Figure  4 gives  an  example  of  this  for- 
mat for  the  Grafenwoebr  MTA.  Due  to  spaie  limitations  only  five  of  the 
six  type  training  categories  appear;  in  the  actual  printout  the  support 
category  also  appears.  This  option  generates  schedule  information  in  this 
form  for  all  four  MTAs . If  any  type  training  category  is  not  scheduled 
for  a given  MTA,  then  that  heading  will  not  appear  on  the  schedule  print- 
out. Notice  that  each  unit  is  identified  with  its  major  headquarters  and 
that  each  training  category  is  ordered  by  period.  Notice  also  that  within 
each  period  the  training  Is  ordered  by  priority.  Tliis  feature  Is  demon- 
strated by  the  training  scheduled  for  the  training  category  of  weapons 
firing  In  Figure  4.  The  first  four  units  all  have  training  scheduled 
during  period  one  and  they  are  ordered  by  priority.  Ttie  first  two  units 
listed,  the  2-36  and  the  3-36/3rd  AD,  have  priority  one;  the  third  unit 
listed,  the  l-36/3rd  AD,  has  priority  two;  .and  the  fourth  unit,  the 
58/llth  ACR,  has  priority  three. 

Summary 

The  computer  assisted  scheduling  system  is  a feasible  alternative  to 
the  completely  manual  system  traditionally  employed  by  V Corps.  It  pro- 
vides the  training  officer  with  the  capability  to  manage  the  training 
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re  3 - AN  HX.A.MPI.fc  OF  SCHEDULE  FORMAT  OPTION  TWO  PRINTED 
BY  THE  V CORPS  MAJOR  TRAINING  AREA  SCHEDULING  PROGRAM 
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Figure  4 - AN  EXAMPLE  OF  SCHEDULE  ^ORMAT  OPTION  THREE 
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si'hodu  1 1-  acHDrd  inn  existinn  priorities,  wliile  relievinn  him  oi  the 
time  eonsnming  task  of  continually  checkinn  training  area  constraints. 
The  computer  program  is  written  in  FORTRAN  IV  programming  language  and 
requires  a computer  system  with  a 230,000  byte  core  storage  capacity. 

The  total  Central  Processing  Unit  time  required  for  one  run  in  less  than 
three  minutes.  The  computer  hardware  requirement  nece- sary  to  support 
this  system  is  satisfied  by  existing  V Corps  assets.  Finally,  the  pro- 
gram output  provides  the  V Corps  training  section  with  scheduling  infor- 
m.ation  in  a form  which  can  assist  in  the  effective  management  of  the 
MTA  chedule  and  facilitate  the  dissemination  of  scheduling 
inform.! t ion . 


REFF.RENCES 


1.  Research  Analysis  Corporation  Technical  Memorandum  RAC-T-465, 

A Method  for  Predicting  Repair  Parts  Replacement  Developed  from  Data 
for  M60  Tanks  and  H113  PACs  (U) , by  John  R.  Bossenga,  et  al , 
pp.  1-214,  January  1966. 

Moore,  M.J.  and  T.  J.  Teesdale,  An  Analysis  of  Major  Training  Area 
Operations  in  V Corps,  U.S.  Army  Europe  (U) , Masters  Thesis,  Naval 
Postgraduate  School,  Monterey,  CA,  September  1977. 


Tin.K;  C’HOOSK 

Al'TItUK;  Mr.  <.Vr.ilJ  Miu-IU-i 

IIS  Army  Arm.uiuMU  R»'.ul  liu'ss  fniiiniainl 

Koik  Island.  11  t.lJOl 


ABSTRACT:  CMDOSK  Is  tin-  nanu‘  ot  a >i>rapiit  i-r  i zed  system  ii-.ed  lo  aid 

I'lioosinjt  the  best  candidate  1 roni  a ln>st  el  actively  cempet  inn  candidates. 
Tills  system  Is  used  In  conjunction  with  .i  user  st  nut  ureil  , it  tribute  system 
against  which  each  ot  the  vandldati'S  .ir«'  judged.  Tr.id  i t ion  a 1 1 v these 
attributes  are  numerically  scored  and  weighti-d  into  .i  mean  overall  score 
tor  each  candid.Ue.  llpon  receivin',  the  mean  over. ill  scores  .iiul  thus  the 
corresponding  r.inking  ot  the  candidates,  the  decision  m.iker  is  lelt 
wondering  lu'w  imuh  better  the  highest  ranking  c.inditlate  is  than  the  next 
line  on  down  the  list,  etc.  CHOOSE  directly  .uldresses  this  problem  bv 
retaining  the  inherent  variability  residing  in  the  .ittribute  scores  .ind 
weights.  This  nondet ermin ist ic  characteristics  ot  the  weights  .ind  scores 
is  used  to  determine  how  s ign  i 1 ic.int  1 v better  the  top  c.iiulidate  is  to 
the  runner  up,  etc. 


I'llOOSK 


TI  TI.K: 

AlTIlOK;  Mr.  lA-rald  Moi-IUt 

I'S  Army  Arnunu'iU  M.itfriol  Roadinoss  Comnumd 
Koik  Isl.ind,  II.  hi  20 1 


CIUKISF.  is  tlu‘  name  ot  .1  lomput  er  i zed  system  used  to  aid  the  M.iaa^;er,  the 
Board  ot  Directors  or  the  decision  committee  in  determininj;  what  the  risk 
is  in  selection  a single  candidate  vi'iidor,  contractor,  di-sign,  etc.,  t rom 
.1  host  ot  actively  com|)»‘t  Ing  candid.ites.  T.he  usual  struct  lire  set  ii|>  tor 
selecting  the  best  c.indidate  consists  ot  est  ah  1 i sli  ing  .1  si-t  ot  attributes 
.igainst  which  cacti  candidate  is  judged.  Kacli  candidate  is  given  a numeri- 
cal score  indicative  ot  liow  well  this  candidate  me.isures  up  to  t lie  ultimate 
qu.ility  level  desired  tor  e.ich  ot  the  given  attributes.  Oenerallv  these 
quality  levels  tor  each  attribute  an-  revii-wed  bv  more  than  oiu'  expi-rt  . 

This  introduces  the  possibility  ot  creating  some  v.iri.ition  in  the  attribute 
scores  (expel  ts  don't  .ilw.iys  agree).  These  attribute  scores  are  tlu'ii  com- 
bined togetiu’r  into  .in  ovi-r.ill  score  tor  e.ich  c.indid.ite.  This  t.isk  is 
gener.illy  .ici'omp  1 i shed  bv  assigning  numerical  weights  to  e.ich  attribute, 
thus  design.it  ing  some  ri'l.itive  importaiue  or  a ranking  ol  importanci'  to  the 
v.irlous  .It  tributes.  For  convenience,  thesi-  wi-ights  .ire  iisii.illv  structured 
to  sum  up  to  1110. t).  However,  man.igers  are  not  .ilw.ivs  in  100'  agrei'ment  on 
the  rel.it  ive  import. inci'  ot  these  v.irioiis  ,1 1 t r ibiit  es . I'luis,  there  .ilso 
exists  the  possibility  ol  variation  in  the  .itiribute  wi'ights.  The  .itlri- 
biite  weights  .ind  scores  .ire  lastly  multiplied  together  .ind  summed  to  yield 
an  overall  score  tor  each  ot  the  caiiil  idat  i-s . Tlu'  c.iiuiid.iles  are  next 
r.inked  from  the  most  di'sir.ible  to  the  le.isl  desirabli'  vi.i  t lu'  m.ignitude  ol 
the  c. ind  id.it  e ' s over. ill  scores.  I’rior  to  m.iking  these  coirn'uf  -tions,  the 
.It  tribute  scores  di'rived  bv  e.ich  expert  in  his  .ittribiiti'  .ire.i  .ind  the 
weights  assigned  to  e.ich  .ittribiite  .ire  .iver.iged  to  remove  the  inherent 
vari.ibilitv  residing  in  e.ich  ot  these  t.uli'rs.  I'pon  receiving  the  me. in 
I'Verall  scores  .ind  thus  the  correspond  ing  r. inking  ol  the  c. ind  id.it  es , the 
decision  iruiker  is  lett  woiuiering  how  miuh  belter  the  highest  r. inking  c.indi- 
d.ite is  th.in  the  next  one  on  down  the  list  , etc..  I'he  decision  m.iker  h.is  no 
way  of  knowing  if  the  top  c.indid.ite  is  s i gn  i I ic.inl  1 v better  th.in  the  second 
r.inking  candid.ite.  It  m.iv  be  th.il  the  diltereiue  between  the  two  t .'p 
cand  lilat  e ' s me. in  over.ill  scores  is  in  tlu-  lu'isi-  U-vi-l  or  it  Pi.iv  be  .1  verv 
signific.int  diflerence.  Bec.iusi-  tlu-  problem  h.is  been  g.iven  .1  deterministic 
tre.itment,  the  decision  m.iker  c.iiini't  .is.ert.iin  the  s ign  i 1 ic.inee  ol  t lu- 
candidates  r.inking. 

ClltlOSF  directly  .uldresses  this  problem  bv  ret. lining  the  inherent  v.ir  i.ib  i I i I v 
residing  in  the  .ittribiite  scores  .ind  weights.  t'lU'OSF  is  .1  sirml.it  ii'ii 
•ipproach  which  accommod.i  t es  the  v.ir  i ib  i 1 i 1 v .>1  the  siores  .ind  weights  down 
at  the  attribute  level  bv  letting  t 'u-  individu.il  .ittribiite  sci'ies  .iiui  t he 
attribute  weights  be  entered  .is  h isl  orgr.ims  or  popu  1 .1  r i .-ed  distributions 
such  as  the  norm.il,  1111  i f orm , I r i .ingu  1 .1  r , eti-..  Al  this  g.r.iss  roots  I ove  I , 
the  statistical  liter. itiire  .iboiinds  with  distribution  i-sl  im.it  i ng  leclniiqiies. 
It  is  not  the  intent  of  this  p.iper  to  discuss  these  t eclin  i qiies , but  r.ither 
to  illustrate  the  facility  tlllllllSf  h.is  tor  pr.-duc  1 i \ e 1 v utili.'ing  those 
t echn  iques . 


UVH)n  starting  oaili  simulatiun  itffatiun,  t lu-  iirngi.inr  i .iiulinnl  v a 

set  of  attribute  welglits  aiul  attrifuite  seores  tor  eai  li  < aiul  iil.il  !•  I i oiii 
their  respei-tive  distributions.  Tlie  neoess.irv  ran  1 l i |>  1 i i at  ion  ot  alliitnile 
weiglits  times  attribute  soon-s  lor  eaoli  oandiilale  is  inadi'  lollowed  liv  I lie 
Slimming  together  ot  the  wi'iglited  attribute  seoii's  tor  eaeh  eaiulidate  into 
an  overall  randid.ite  seore.  The  eandid.it  es  aie  next  r.inked  .leeording  to 
their  overall  seore  lor  this  iter.it  ion.  Tlu'  e.mdid.ite  r.inkings  lor  e.ieh 
iter.it  ion  are  progressively  .leeumn  1 .it  ed  togetliei  to  yield  the  nuvil.ei  o‘ 

Limes  eaeh  e.mdid.ite  plaeed  in  eaeh  of  the  iiossihle  r. inking  posit  ioio-. 

Use  ot  this  svsti'm  iKsirly  di'inons  l r.it  I'S  th.it  in  iii.inv  seleet  ion  problems 
the  varianee  residing  in  the  .ittribnti'  seori's  ,iiid  weights  e.in  dr.ira.it  ii.illv 
etteet  the  eonfidenee  levi'l  when  m.iking  .i  e.mdid.ite  .seKnt  ion.  Toi 
instanee; 

A 25  attribute  seleet  ion  problem,  with  the  over. ill  seoies  being  .ible  to 
range  t rom  0 to  100,  h.id  me. in  over. ill  seores  of  88  .ind  8,  respee  t i ve  I v 
tor  the  two  top  eand  id.it  es  . Ilowi'ver,  upon  eiili'iing  the  level  of  v.i  r i.ib  i I i t v 
expressed  by  the  seoriiig  experts  .iiul  m.m.igers  .issigning  the  weig.liis,  tin- 
top  e.indidate  w.is  the  winner  81°'  ot  tin-  t iiiie,  while  the  nniner  up  w.is  t In- 
winner  of  the  time.  In  ,i  simil.ir  25  .ittribiile  seleet  ion  problem,  I In- 
to(>  two  eand  id.it  I’S  h.id  mean  ovi-r.ill  seores  ul  81  .iiul  h‘t  respeet  i ve  1 v . 
However,  when  entering  the  li'Vel  of  v.i  r i.ib  i 1 i I v expressed  bv  the  si-oring 
ex()erts  and  numagers  in  the  .in.ilvsis,  the  top  e.mdid.ite  was  the  winner 
only  bit.  ot  the  time,  while  the  runner  up  w.is  the  winiu-r  AO™  ot  the  t ime 
and  the  rem.iining  i','.  went  to  the  otlu-r  eandidati'S.  These  two  ex.impli'S 
elearly  indieati-  th.it  the  m.ignitnde  ot  tin-  dilti-renee  between  the  me. in 
overall  candidate's  seores  is  not  necessarily  inilie.it  ive  ot  how  imuh  betti-r 
or  worse  a given  candid. ite  is  when  ei'nn'ared  to  another. 

Wlien  a low  coni  idenee  selection  occurs  it  is  often  advis.ible  to  critic.illv 
review  those  scores  anil  weights  which  tend  to  cause  the  candidates  to  be 
r.inked  in  an  order  different  from  tlu'  me. in  r. inking.  The  I'rocess  ot  I ind- 
ing  these  critical  scores  and  weights  can  be  aided  by  the  use  of  the  sensi- 
tivity an.ilysis  features  structured  in  UlltlDSn.  CIIOOSK  assigns  each  score 
and  weights  its  me.m  value  and  then  takes  one  given  si'ore  anil  s vs t em.'i t i la  1 1 v 
increases  it  in  value  until  the  upper  bound, irv  of  its  tl  i s t r i but  ion  has  been 
reached.  Along  the  way  up  to  the  iippi't  boinulary,  all  the  crossover  points 
which  causi'd  a reranking  of  the  iMiid  i d.it  es  is  noted,  if  aiiv  .such  crossover 
points  exists.  After  riiiming  up  to  t lu'  iippi-r  bound.i  rv , UlltlOSl'  returns 
this  given  score  to  its  me.m  v.iliie  .md  then  systematically  decreases  it  in 
V.I  1 lie  until  the  lower  bound. irv  of  Its  distribution  has  been  reached. 

Ag.iin,  .ill  the  crossover  t'oints  .ire  noted.  After  all  the  scores  are 
an.ily/.ed  .is  previously  describeil,  the  weights  are  .ilso  given  the  same 
an.ilvsis.  Upon  finding  the  critical  scores  and  weights,  it  maybe  advisable 
to  spend  some  ext r.i  money  to  study  the  critical  scores  and  weights.  Per- 
haps some  of  the  attributes  were  ill-structured  or  not  inclusive  enough 
or  the  scoring  experts  were  not  expert  enough,  etc..  At  any  rate,  the 
sensitivity  analysis  should  provide  a starting  point  for  augmenting  the 
analysis  made  to  date  so  that  greater  confidence  can  be  icliieved  in 
choosing  the  winner. 
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wrii',ht  ilisliiluil  ini'. . Ap,.iiii  it  Ihr  v.iliir  i uiiipiit  nl  lur  I hi'  nils. imp  1 1'll 

wrip.hl  ilisliiluil  imi  iliu".  iiul  lir  wilhiii  ils  i.iiip,r,  I hr  i rs.imp  I i up  prui  rss 

Is  irpr. Ill'll  iiiilil  .III  .11  I rpi  .ih  I r v.iliir  lur  ihr  iim.implnl  il  i s I r 1 hut  i ml  is 
truiiil.  I'lii  r .1  '•iiit.ihlr  lumh  i ii.il  iuii  ut  wrip,hl'.  h.is  hrrn  luuiiil,  thr  wi'Uthts 
.III'  suhji'ilnl  I u Ihr  wrip,hl  i mi-.t  1 .1  i ii  I . It  .iiiv  ul  ihr  nuis  t r.i  i il  I s .irr 
viul.ilnl,  Ihr  whulr  pi  ui  r-r.  is  st.irlnl  uvrr  1 rum  Ihr  hrp,  i nil  i up,  .mil 
irpr. Ill'll  uiilil  .1  -.iiil.ihlr  i.iiiilrmlv  srlnli'il  I'miihin.il  imi  ul  wriphls  h.is 
hrrii  ti'uiiil  whilh  will  iiul  viul.ilr  .mv  ul  thr  wri>'.hl  runs  I r .i  i ii  t s . 

Anuthri  Ir.iluir  I'llOOSl'  li.r-  is  Ihr  .ihilitv  lu  .iri'ummuil.il  r srlnliun  pruhli'nis 
whilh  h.ivr  hrrn  suh  I .ii  I u i r il  inlu  .illrihiilr  livrls.  Vur  rx.impli',  it  m.iv 
hr  .lilv.int  ,ip,ruus  I u htf.ik  .i  'inuri  r srlnl  iuii  ptuhlrni  up  iiitu  Ihri'U  prim  iplr 
illrihulr  .in. is  ul  m.iii.iprmriil  , i u.s  i .nu)  I nhii  i i .i  1 .ihilitv.  Inilrr  r.irh  ul 
tlirsr  Ihrrr  prinrip.il  .ittiihutr  .irr.is,  suh.it  t r ihul  rs  m.iv  hi'  strui'lurnl  .mil 
iiiiili'i  Ihrsr  suh.it  I 1 ihul  rs  ul  hrr  suh.il  I 1 ihul  rs  m.iv  hr  slriii  turril,  rtr.. 

Vhr  lullrwinp,  vi'iv  simplilinl  .u  I ii.i  1 ptuhlrni  i 1 I us  I r.i  I iss  huw  tlllOO.Sh  r.in  .liil 
in  I III'  prui'i'.s.s  ut  I'huu.'.  i lip  l hr  wiiiiirr.  A r.iinlv  m.iniil  .ul  uri'i  h.is  t wu  iirw 
I'.iiiil  i il.il  r I'.imlirs  it  is  runsiilri  inp,  putt  inp,  mil  un  Ihr  m.irki't.  lluwrvrr, 
Ihi'ii'  is  unlv  rnuup.h  prumut  imi.il  munrv  .iv.iil.ihlr  lur  1 .lunrli  i np,  uni'  ul  thr 
t wu  r. Iiul  i il.it  I'S  . 11  i s I u r i I'.i  1 I V . this  ruiiip.inv  h.is  usnl  ,i  luur  l.u'tur  svst  rm 

lu  rv.ilu.iti'  Ihr  m.irkrt  puti'iiti.il  ul  r.imlii'S.  This  svsli'm  runsists  ul  (1) 
l.isir,  (J)  sinr  I I , .im!  (1)  luuks.  I.uuks  w.is  liirlhrr  siihl.iit  urril  inlu  (hi) 

I ii'h  .ippr.i  r.iiirr  .mil  ( ih)  uniturm  trxiurr.  Thr  Itu.iiil  ut  Di  rrilur' s prr- 
Irrrnrrs  lur  wrip,hlinp,  tlii'si'  l.uturs  inlu  .in  uvi’r.il  1 srurr  lur  r.iih  r.mili- 
il.itr  m.n>s  intu  thr  lullrwinp,  lri,mp,ul.ir  il  i st  r Unit  i uns ; 
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attributes.  Plots 

of  the  responses 

for  these 

four  attributes  fit 

the 

normal  distribution 

and  further  passed  the  chi 

square  of 

goodness 

of  f it 

test  at  a high  significance 

level . 

The  resultant  means 

(rounded) 

and 

standard  deviation 

(rounded) 

are  as 

follows : 

ATTRIBUTE 

CANDIDATE  #1 

CANDIDATE  #2 

Mean 

Std.  Dev. 

Mean 

Std.  Dev. 

Taste 

87 

2.7 

73 

2.8 

Smell 

67 

2.3 

72 

2.9 

Rich  Appearance 

62 

3.1 

77 

3.4 

Uniform  Texture 

81 

3.6 

84 

3.3 

Candidate  No.  1 and  No.  2's  mean  overall  score  was  76.5  and  74.5  respec- 
tively. The  narrow  spread  between  the  mean  overall  scores  may  tend  to  lead 
the  Board  of  Directors  into  thinking  that  it  is  a toss-up  between  the  two 
candidates.  However,  inquiry  into  the  significance  of  these  scores  via 
the  use  of  CHOOSE  clearly  shows  that  candidate  number  1 is  a significantly 
better  choice  since  it  was  the  simulated  winner  85%  of  the  time. 

CHOOSE  has  been  coded  in  FORTRAN  IV.  The  program  is  very  flexible  in  being 
able  to  handle  a wide  range  of  problem  sizes  and  structures.  It  will  cur- 
rently handle  problems  of  up  to  75  attributes  and  1000  iterations  in  a 
lOOK  bytes  region  on  IBM  360  gear.  Large  problems  and  more  iterations  are 
and  can  be  accommodated,  however,  more  core  will  be  required.  Users  must 
code  the  attribute  level  structure,  the  weight  constraints  and  the  multi- 
plication and  addition  of  the  weights  and  scores  into  overall  scores  for 
each  candidate.  There  isn't  any  documentation  for  the  program  and  this 
currently  makes  it  difficult  to  use.  However,  CHOOSE  has  been  well  tested 
on  many  private  industry  problems  and  few  military  problems. 
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ABSTRACT : The  Army's  present  mini-RPV  program  is  in  tlie  advanced 

development  phase  of  its  life  cycle.  At  this  point  in  the  lile  cycle, 
any  definite  analysis  is  very  difficult  because: 

a.  Of  the  lack  of  a definite  requi rement (s) . 

b.  The  various  type  of  equipment  available  .ind  useful  for  RPVs,  but 
in  different  stages  of  their  deve lopim'nt . 

However,  the  Army  needs  from  the  developer,  a lie  tier  definition  of 
programs,  in  terms  of  cost  and  schedule,  earlier  in  the  program.  This 
paper  is  a result  of  the  Army's  need  to  define  the  cost  and  schedule  of 
the  RPV  program.  The  process  described  was  in  fact  used  to  develop  tlie 
risk  portion  of  the  RPV  outline  development  plan.  The  paper  shows  the 
analyst  how  to  identify  the  areas  of  uncertainty  within  the  progr.im  and 
the  degree  (level)  of  uncertainty  for  the  requirements,  program  schedule, 
technical  risk  and  cost  estimating  mt'thodology . The  paper  also  presents 
the  results  of  the  actual  uncertainty  analysis  for  the  Army's  Rl’V 

Iix  Program.  Each  subsystem  risk  level  has  been  assessed  with  respect  to  the 

various  contingencies.  This  paper  also  presents  the  results  of  tlie 
actual  analysis  for  the  Army's  RPV  program  along  witli  nK'thods  for  other 
applications  to  other  programs  and  equipment. 
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US  Army  Aviation  Research  and  Development  Command 
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INTRODUCTION 

In  making  decisions  in  cost  estimating,  top  management  is  faced  with  the 
difficulty  of  evaluating  assumptions  which  involve  uncertainty.  In 
general,  uncertainty  and  risk  are  used  as  synonymous  terms.  In  decision 
theory,  the  distinction  is  made  tliat  the  concept  of  risk  deals  with 
measurable  probabilities  while  the  concept  of  uncertainty  does  not. 

To  perform  a complete  uncertainty  analysis,  the  following  elements  must 
be  considered: 

a.  Requirements  uncertainty.  This  is  due  to  the  fact  that  the 
system  configurations  are  subject  to  a variety  of  changes  introduced 
during  the  development  program. 

b.  Program  schedule.  Schedule  slippage  depends  on  requirement 
changes  and  unforseen  major  technical  problems. 

c.  Technical  risk.  This  can  be  caused  by  unforseen  technical 
problems  or  technical  changes. 

d.  Cost  estimating  methodology.  Uncertainty  about  the  point 
estimate  due  to  variability  of  data  and  the  techniques  used  to  analyze 
the  data. 

The  uncertainty  level  assessed  for  each  subsystem  is  based  upon 
definitions  shown  in  the  following  table. 

RISK  ASSESSMENT 

The  RPV  subsystems  considered  feasible  have  been  reviewed  for  the 
requirement,  schedule,  technical  risk  and  cost  estimating  technology 
uncertainty.  These  subsystems  are: 

a.  Airframe. 

b.  Propulsion. 

c.  Flight  Control. 

d.  Navigation. 


845 


e.  Mission  Equipment. 

f.  Data  Link. 

g.  Launch . 

h.  Recovery. 

i.  Ground  Control  Station. 

j.  Ground  Support  Equipment /Test  Measurement  and  Diagnostic 
Equipment . 

The  uncertainty  levels  assessed  to  each  subsystem  are  based  upon  the 
definitions  shown  in  the  following  table — Uncertainty  Analysis  Crtjlde. 

The  following  is  a brief  description  of  the  functions  and  characteristics 
of  each  subsystem  with  the  uncertainty  level  assessed.  This  can  be  used 
as  a guide  to  provide  information  to  improve  the  rationality  of  the 
trade-offs . 

Airframe : 


a.  Fixed  Wing  RPV.  The  fixed  wing  and  rotary  wing  RPV  airframes  are 
made  of  plastics  and  fiberglass.  The  primary  objective  in  the  structure 
area  is  to  make  it  lightweight,  low  cost,  and  with  low  radar  cross 
section.  The  airframe  for  both  types  of  vehicles  should  be  designed  to 
protect  the  electronics  and  sensors  and  be  able  to  recover  them  in  usable 
condition  in  case  of  crash. 

(1)  Requirements.  Low  uncertaintv. 

(2)  Program  Schedule.  Very  low  uncertainty. 

(3)  Technical  Risk.  Very  low  uncertainty. 

(4)  Cost  Estimating  Methodology.  Low  uncertainty. 

b.  Rotary  Wing  RPV.  There  has  been  very  little  work  done  on  rotary 
wing  RPVs.  They  present  a problem  with  high  vibration,  stability,  and 
difficulty  in  achieving  a hover,  but  they  have  an  advantage  in  the  launch 
and  recovery  operation. 

(1)  Requirements.  Very  high  uncertainty. 

(2)  Program  Schedule.  Very  liigh  uncertainty. 

(3)  Technical  Risk.  Very  high  uncertainty. 
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off-the-shelf  adaptation  from  lawn  mowers,  chain  saws,  or  go-carts. 

There  is  limited  development  effort  being  expended  on  new  engines. 
Technical  risks  fall  into  three  areas:  (1)  future  horsepower 
requirements  require  development  of  a whole  new  engine  (very  low  risk 
with  the  existing  engines);  (2)  endurance — the  present  engines  have  not 
been  able  to  stand  up  to  the  demands  of  longer  endurance  missions;  (3) 
quality  of  the  present  engines  is  not  high  enough  to  allow  purchase  and 
direct  installation  of  the  engine  without  rework. 

(1)  Requirements.  Very  low  uncertainty  with  the  existing  engines. 
High  with  a new  engine  program. 

(2)  Program  Schedule.  Very  low  uncertainty  with  the  existing 
engines.  High  with  a new  engine  program. 

(3)  Technical  Risk.  Very  low  uncertainty  with  the  existing  engines. 
Medium  with  a new  engine  design. 

(4)  Cost  Estimating  Methodology.  Very  low  uncertainty  with  the 
present  engine.  Medium  uncertainty  with  a new  engine  program. 

Flight  Control: 

a.  The  Electrostatic  Stabilizer.  To  reduce  the  skill  level  needed 
for  the  operator,  it  is  felt  that  an  autopilot  is  required.  The 
electrostatic  stabilizer  does  not  provide  a complete  autopilot 
capability,  since  only  the  roll  and  pitch  angles  are  held  constant.  An 
altimeter,  magnetometer,  and  pitot  tube  sensor  would  have  to  be  added  to 
provide  an  altitude,  heading,  and  velocity  hold  capability.  The 
electrostatic  equipotentlal  planes  are  known  to  deviate  from  the 
horizontal  near  thunderstorms,  and  use  of  electrostatic  sensors  would 
pose  a definite  limitation  on  flights  made  during  thunderstorms. 
Additional  basic  R&D  work  is  required  before  it  can  be  used  successfully 
in  RPVs.  This  stabilizer  is  radioactive  and  loses  sensitivity  due  to 
radioactive  decay  requiring  periodic  replacement, 

(1)  Requirement.  Low  uncertainty. 

(2)  Program  Schedule.  Very  low  uncertainty. 

(3)  Technical  Risk.  Low  uncertainty. 

(4)  Cost  Estimating  Methodology.  Low  uncertainty. 
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b.  Environmental  Reterence  /iutopilot.  This  autopilot  provides 
flight  corrections  based  upon  external  environmental  parameters  such  as 
static  pressure,  angle  of  attack,  and  geomt‘tric  flux.  ITie  system  ’ s 
inexpensive  and  lightweight.  The  autopilot  has  a magnetometer  for 
heading  indication  that  can  be  in  error  while  the  aircraft  is  banked,  due 
to  the  large  dip  of  the  geomagnetic  vector  in  tlie  temperate  zones.  Solar 
storm  conditions  affect  the  earth's  magnetic  field  and  would  provide  some 
limitation  on  the  usefulness  of  a magnetometer.  This  system  also  lacks 
vertical  reference  that  makes  it  less  suitable  for  Rl’V  missions  requiring 
target  location  and  artillery  adjustment,  without  tlie  addition  of  a 
position  gyro  to  provide  an  accurate  aircraft  orientation  capability. 
Technical  risk  is  considered  very  low. 

(1)  Requirement.  Low  uncertainty. 

(2)  Program  Schedule.  Very  low  uncertainty. 

(3)  Technical  Risk.  Very  low  uncertainty. 

(4)  Cost  Estimating  Methodology.  Very  low  uncertainty. 

c.  Position  Gyro  Autopilots.  This  autopilot  system,  in  addition  to 
the  vertical  gyro,  has  a directional  gyro  with  a flux  gate  (magnetometer) 
.md  an  automatic  altitude  control.  This  autopilot  is  heavier  and  more 
expensive  than  the  other  two.  However,  it  provides  an  accurate 
directional  reference  during  short  periods  of  banked  or  maneuvering 


flight. 

(1) 

Requirement . Low 

uncertainty. 

(2) 

Program  Schedule. 

Very  low  uncertainty. 

(3) 

Technical  Risk. 

Very  low  uncertainty. 

(4) 

Cost  Estimating  Methodology.  Low  uncertainty 

Navigation: 

There  are  two  categories  of  operational  mode  for  RPV  navigation:  First, 
the  determination  of  the  position  of  the  RPV  made  at  the  ground  control 
station  (ground  computation  of  position).  Second,  the  determination  made 
on  board  the  RPV  (airborne  computation  of  position). 

a.  Ground  Computation  of  Position.  With  this  system,  the  RPV  flight 
must  be  directed  by  ground  command,  via  a data  link.  This  data  link  can 
be  vulnerable  to  enemy  electromagnetic  interference  unless  anti-jam 
techniques  are  incorporated  in  the  system. 
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(1)  Requirement.  Medium  uncertainty. 

(2)  Program  Schedule.  Medium  uncertainty,  depending  on  development 
results . 

(3)  Technical  Risk.  Medium  uncertainty,  considering  the  anti-jam 
protection  that  has  to  be  incorporated  in  the  data  link. 

(4)  Cost  Estimating.  Medium  uncertainty.  The  anti-jam  technique 
selected  has  to  be  supported  by  a demonstration  test. 

b.  Airborne  Computation  of  Position.  The  RPV  can  be  internally 
preprogrammed  to  fly  to  a sequence  of  selected  waypoints  without  contact 
with  the  ground  control  station.  Programmers  are  basically  clocks  which 
activate  many  functions  at  predetermined  time  intervals. 

(1)  Requirement.  Very  low  uncertainty. 

(2)  Program  Schedule.  Very  low  uncertainty. 

(3)  Technical  Risk.  Very  low  uncertainty.  A similar  system  has 
been  used  in  other  applications. 

(4)  Cost  Estimating  Methodology.  Very  low  uncertainty. 

Mission  Equipment : 

Perhaps  the  most  progress  to  date  has  been  made  in  the  payload  area. 
Small,  low-cost  television,  laser,  and  flir  systems  have  been  developed. 
Some  work  is  still  necessary.  Interchangeable  payloads  are  being 
designed  to  perform  unmanned  airborne  missions  for  real  time 
surveillance,  reconnaissance,  and  target  acquisition,  location,  and 
designation. 

a.  Real-Time  TV  Surveillance.  A TV  camera  will  be  used  to  detect 
tanks . 

b.  Real-Time  TV  and  Photo  Reconnaissance.  A 35iran  or  70mm  panoramic 
camera  will  be  added  to  the  TV  system. 

c.  Target  Acquisition.  A stabilized  TV  system  with  automatic 
tracking  will  be  used  to  extend  the  RPV's  daytime  detection  range. 

d.  Target  Location  and  Artillery  Adjustment.  A laser  range  finder 
will  be  added  to  the  stabilized  TV  system  and  boreaighted  through  the 
camera  to  provide  tracking  accuracies. 
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(1)  Roquiremont . Very  hlsh  uncertainty. 

(2)  Program  Scheilule.  Very  lilgli  uncertainty. 

(3)  Technical  Risk.  Very  high  imcertainty . 

(4)  Cost  Estimating  Metliodology . Very  high  uncertainty, 
haunch : 

n»ere  is  no  gre.at  difficulty  with  the  launch  of  minl-RPVs  with  a number 
of  alternatives,  including  catapults,  stored  energy  launchers,  and  the 
vehicle  powered  launch. 

a.  Catapult.  Tlie  launcher  for  the  Aqulla  uses  a 300  psl  air 
compressor.  There  are  other  possible  power  sources.  Including  a 
mechanical  spring  or  gas  generator  cartridge. 

(1)  Requirement.  Verv  low  uncertainty. 

(2)  Program  Schedule.  Very  low  uncertainty. 

(3)  Technical  Risk.  Very  low  uncertainty. 

(4)  Cost  Estimating  Methoilology . Very  low  uncertainty. 

h.  Stored  Energy  Launcher.  Energy  is  stored  in  a flywlieel  or  spring 
which  is  dissipated  to  launch  the  RPV.  The  flvwheel  has  a complex 
mechanism  compared  to  the  bungee  system  that  is  very  simple,  less  costly, 
and  more  reliable.  Any  bungee  system  presents  a hazard  in  the  bungee 
cords  either  bre.tking  or  coming  loose  from  the  cart  or  other  secure 
point.  Technical  risks  are  considered  very  low. 

(1)  Requirement.  Very  low  uncertalntv. 

(2)  Program  Schedule.  Very  low  uncertainty. 

(1)  Technical  Risk.  Very  low  uncertainty. 

(4)  Cost  Estliruitlng  Methodology.  Very  low  uncertainly. 

c.  Vehicle  Powered  Launch.  This  is  .iccompl 1 shed  with  the  vehicle 
powered  or  vehicle  plus  booster  take-off  in  various  configurations.  The 
truck  launch  would  he  the  most  applicable  configuration  and  does  not  add 
nddltlon.al  weight  to  the  RPV.  The  truck  launch  would  invoke  some  delav 
between  launches  ;ts  a new  vehicle  is  nuniuted  and  prepared  for  I light. 
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(1)  Requirement.  Very  low  uncertainty. 

(2)  Program  Scliedule.  Very  low  uncertainty. 

(3)  Teclinical  Risk.  Very  low  uncertainty. 

(4)  Cost  Kstlmating  Methodology.  Very  low  mice rtainty . 

Recovery ; 

a.  Net.  This  is  the  system  now  being  useil . Tlie  net  catches  the  KI’V 

wtien  it  is  flown  into  it.  Damage  to  the  Rl’V  from  the  abrupt  stop  and 

difficulty  of  removing  tlie  veliicle  from  the  net  are  tlie  major  drawbacks 
to  the  net  systems.  The  removal  of  an  RPV  from  a net  is  a difficult 
task;  it  could  be  tangled  in  lines  or  suspended  five  or  more  feet  above 
the  ground.  Nets,  either  vertical  or  horizontal,  will  require  skill  to 
land  with  undue  damage  to  the  RI’V  or  develop  an  automatic  landing  system. 

(1)  Requirement.  Medium  uncertainty. 

(2)  Program  Schedule.  Medium  uncertainty. 

(3)  Technical  Risk.  Medium  uncertainty. 

(4)  Cost  Kstimating  Methodology.  Medium  uncertainty. 

b.  Parachute.  This  system  provides  limited  control  of  the  descent. 

It  could  land  in  trees,  rough  terrain,  or  strike  the  grouml  in  the  wrong 
attitude,  .and  it  is  at  the  mercy  of  tlie  winds.  The  chute  is  folded  on 
board  the  aircraft,  and  the  mechanism  needed  to  activate  the  chute  will 
add  a weight  penalty  to  the  RPV.  Tlie  chute  has  to  be  repacked  and 
inspected,  and  any  aircraft  parts  destroyed  with  each  landln,;  have  to  be 

replaced.  The  advantage  that  the  parachute  offers  is  the  operational 

flexibility.  The  system  is  not  limited  to  any  certain  terrain  and 
Involves  no  set  up  or  tear  down  to  liamper  tactical  nKivements. 

(1)  Requirement,  l.ow  uncertainty. 

(2)  Program  .Schedule.  Low  uncertainty. 

(3)  Technical  Risk.  Low  uncertainly. 

(4)  Cost  Estimating  Methodology.  Low  uncertainty. 

c.  Helium  Bag  with  Vertical  Straps.  Tills  system  consists  of  two 
bags,  one  filled  with  helium  and  the  other  with  air.  Vertical  straps  are 
attached  to  the  floating  bag  and  to  the  air  bag,  which  remains  on  the 
ground  to  form  a vertical  net  about  30  feet  high.  Tlie  KPV  flys  into  tlie 
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vortical  straps  and  oatohos  aiu'  '.'n  oaoli  winp,  tip.  rln-  vohioU'  tlioii 
sot  t los  onto  tlio  airbap,  wliiob  is  tw;t  inp  on  tlio  prmind.  Kltlu'i  bot  t lod 
bolinni  or  orpiipniiMU  to  U)oallv  ponorati'  tlu-  p.is  wonld  In'  roipilrod.  Ttu- 
baps  ( U) ' X lb'  X b')  will  bo  larpo  and  boavv , .ind  tbi“V  bavo  t<'  bo 
dot  latod  tor  transport.  Tbo  baps  will  roipiiro  tbo  rop.iir  ol  anv  loaks 
tliat  occur.  Tbo  svstom  will  bo  suscopfiblo  to  proliloms  in  a windy 
onvironmont  duo  to  possiblo  driltlnp  .ind  sbiltlnp.  Tbo  b.ips  b.ivo  to 
romaln  int  latod  ovon  wlion  no  roci>vorv  opor.it  ions  .iro  undorw.iy,  duo  to 
tbo  tlnk’,  cost,  .ind  dllflcultv  Involved  in  dotl.itinp  .ind  intl.itinp  tbo 
b.ips.  This  system  is  not  opo ra t i onal  1 v t loxiblo;  it  roipiiros  sot  up  .ind 
tear  down  time  botoro  tbo  unit  nuiv  bo  relocated.  It  is  dlltioult  to 
concea 1 . 

(ll  Roqui  ronioiit  . l.ow  unco  rt  .li  nt  y . 

(J)  I'ropram  Schodulo.  l.i'w  uncort.iintv . 

(^ll  Tocbnical  Risk.  l.ow  uncortaintv;  does  require  dovolopmont 
oftort . 

(4)  Cost  Kstimatlnp  Mot liovlo lopy . l.ow  uncort.iintv. 

('.round  Control  Station: 

Tbo  pround  control  st.it  ion  consists  of  a sboltor  tb.it  will  liouso  .ill  tlio 
data  procossinp  controls  .ind  ilisplays  nocoss.iry  tor  the  planninp, 
launcb/rocovory , onrouto  .ind  terminal  pb.isos  of  Rl’V  flipbt.  The  st.ition 
Ii.'is  to  bo  .iblo  to  control  .several  RI’Vs  in  various  phases  ot  ,i  mission 
simultaneously,  and  it  is  required  to  bo  almost  invulnor.iblo  to  enemy 
detection,  to  bo  nuibilo,  .ind  to  b.ivo  a minim. il  tear  down  and  .sot  up  time. 

(1)  Requirement.  *Illpb  uncertainty. 

(2)  I’ropram  Schodulo.  *lllpb  uncertainty. 

(3)  Tocbnical  Risk.  *Hlpb  uncertainty. 

(4)  Cost  Kstlmatinp  Motbodolopv.  *nipb  uncort.iintv. 

* The  risk  Is  considered  to  bo  bipli  because  of  tbo  station  required 
capability  to  control  several  RI’V.s  in  various  phases  of  a mission 
simultaneously,  and  tbo  teebnique  used  to  minimise  the  station's 
vulnerability  to  enemy  detection. 

Ground  Support  Equ  1 piiH'n t /Tos t Measuremen_t  aiul  I'Hjij^nos t i c Ei^uijiment  : 

The  simplicity  of  the  alrfranx'  and  enplne  will  not  dictate  requirements 
for  extensive  Ground  Support  Equipment.  Test  Measurenn'iit  and  lU.ipiiost  ic 
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Equipment  in  support  of  the  mission  equipment  appears  to  be  the 
dominating  requirement. 

a.  Ground  Support  Equipment.  The  RPVs  ground  starting  provision 
would  be  incorporated  into  the  launcher. 

(1)  Requirement.  Very  low  uncertainty. 

(2)  Program  Schedule.  Very  low  uncertainty. 

(3)  Technical  Risk.  Very  low  uncertainty. 

(4)  Cost  Estimating  Methodology.  Very  low  uncertainty. 

b.  Test  Measurement  and  Diagnostic  Equipment.  The  deployment  of 
the  RPVs  indicates  simple  pre-flight  checkout  equipment.  Fault 
isolating  capability  would  be  only  to  the  major  component.  A complete 
diagnostic  test  capability  would  be  appropriate  at  the  maintenance  level. 

(1)  Requirement.  Very  low  uncertainty. 

(2)  Program  Schedule.  Very  low  uncertainty. 

(3)  Technical  Risk.  Very  low  uncertainty. 

(4)  Cost  Estimating  Methodology.  Very  low  uncertainty. 

c.  Miiintenance  Facilities.  The  use  of  vans  or  shelters  which  are 
operational  on  their  mobilizers  appears  to  be  the  requirement  for  RPVs. 
Another  significant  need  for  shelters  is  to  allow  night  operations  or 
maintenance  under  blackout  conditions. 

(1)  Requirement.  Very  low  uncertainty. 

(2)  Program  Schedule.  Very  low  uncertainty. 

(3)  Technical  Risk.  Very  low  uncertainty. 

(4)  Cost  Estimating  Methodology.  Very  low  uncertainty. 

SUMMARY /CONCLUSION 

This  analysis  has  provided  information  for  trade-offs  rationality.  The 
analysis  placed  in  perspective  each  subsystem  risk  value  with  respect 
to  various  contingencies,  and  it  is  intended  to  give  the  decision  maker 
the  information  to  improve  the  rationality  of  his  decision  and  a more 
accurate  program  cost  estimating.  The  summary  table  shows  the  risk 
uncertainties  levels  for  the  RPV  subsystems. 
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of  More  Than  Two  Means 
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ABSTRACT: 

A test  procedure  for  the  equality  of  morethan  two  means  involving  the  inter- 
section of  iJj^=)j2=. . . = with  the  k-dimensional  confidence  ellipsoid  on 

Pi,  Oj, . . . , is  defined  in  this  dissertation  as  a Confidence  Region  Pro- 
cedure For  Testing  the  Equality  of  More  Than  Two  Means.  The  need  for  this 
procedure  is  shown  in  Chapter  II.  The  procedure  is  developed  in  Chapter 
IV  and  practical  applications  of  of  the  procedure  are  presented  in  Chapter 
V. 

A History  of  Simultaneous  Inference  and  Hypothesis  Testing  (Chapter  III) 
includes  both  the  philosophy  of  traditional  null-hypothesis  significance 
tests  and  the  philosophy  of  the  confidence -region  procedure.  A brief  dis- 
cussion summarizes  the  primary  differences  between  inference  and  decision 
theory. 

Both  the  generalized  on-way  Analysis  of  Variance  (ANOVA)  and  the  generalized 
confidence-region  procedure  are  developed  in  this  vrork.  The  distribution  of 
the  variables  is  restricted  to  the  normal  distribution  with  known  and  unknown 
variance.  The  sampling  distribution  is  taken  to  be  normal  with  a mean  and 
standard  deviation  equal,  respectively,  to  the  unknown  location  and  scale 
parameters  of  the  related  random  variable  distribution. 

After  developing  the  confidence  region  procedure  to  test  the  equality  of 
more  than  two  means,  the  author  includes  tables  and  calculation  details 
which  apply  these  procedures  to  two  actual  examples.  The  random  variable 
selected  for  the  first  example  is  the  fragment  velocity  in  a detonator  test 
while  for  the  second  example,  the  random  variable  is  base  overhead  (0/H) 
rates  for  the  various  military  installations  in  the  United  States. 
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Dr.  Lewis  S.  Flchter 
ARRADCOM  HDQTS 
Dover,  New  Jersey  07801 


Jones  and  Karson  ( 3)  equated  the  elliptical 
confidence  region  test  for  k=2  populations  directly 
to  the  standard  Z test  with  knov/n  comon  o.  It  would 
seem  that  a natural  and  logical  analogy  could  be  drawn 
between  the  elliptical  procedure  for  k > 2 populations 
and  the  one-way  A::ova  test.  The  development  which 
follows  is  an  algebraic  ger.eralitation  of  the  analogy 
between  the  ellipsoidal  procedure  for  k > 2 populations 
and  the  one-way  At.'OVA  test.  Ultimately  a relationship 
between  their  respective  "F"  values  is  derived.  The 
theoretical  development  includes  k=2,  as  a special 
case  for  completeness  and  clarity. 

In  general,  the  following  approach  is  taken: 

(1)  For  a given  value  of  k,  the  one-way  AkOVA 
test  statistic  for  llg  vs.  is  given  algebraically , 
and  the  corresponding  level  ^ tost  procedure  formul-itea. 
This  test  statistic  is 


k 2 ( r n.X.)' 

s n.xr  _ i=l  ^ ^ 

• 1 ^ ^ n 


1 


(') 


1) 


(Jc-l,n-k) 


The  test  procedure  is  to  reject  Uq.'  =» 

at  level  a if  ? ^ (k-l,r.-k,  1-a) 

8 SO 


(2)  A sinmltaneous  ellipsoidal  confidence  region 
for  ( U2«  • • • at  level  100  (1-Y)  is  determined  for 
the  hypothesis  testing  problem  which  is  at  level  o; 

Hq  is  not  rejected  if  Wj^  - U2  - ....  - intersects  the 
ellipsoid. 

(3)  The  form  of  an  arbitrary  ellipsoid  for 

is 

jk  (X^  - »i.)2  ,(2) 


Based  on  the  fact  that 

nj^(X  - + n2(X2  - ^2^^  •*“ ^ 


is  distributed  as  n-k)  ' 100  (l-y)  % simultaneous 

ellipsoidal  confidence  region  for  W2»**»  ^k  given 

by  ^ 

W2'  •••  Wk)  1 J«Sp  f(k,n-k,l-Y)^ 


Consider  the  expression  from  (12)  given  by 

k 2 ' 5 

I “ ks;:  f,,, 


p "{k,n-k,l-Y)* 


This  is  equivalent  to 


I n.  (X.  - W.)^ 

1-1  ^ ^ ^ 


- 1 . 


kS^  f 

^(k,n-k,l-Y) 
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2 

It  is  now  easy  to  see  that  the  expression  for  a^  in  (2) 
can  be  written  as 
kS^  f 

2 ^(k,n-k,l-Y)_  (5' 

"i 

In  suitutiary  then,  the  procedure  developed  in  this 
paper  labelled  the  ellipsoidal  procedure  is  an  alter- 
nate method  to  the  ANOVA  for  testing  the  equality  of  more 
than  two  means.  It  is  based  on  the  simultaneous  confidence 

region  for  ) which  is  an  ellipsoid  in 

■*■2  k 

^2 » • • • space  as  in  2 • Basically,  the  ellipsoidal 

procedure  is  to  determine  those  combinations  of 
(3f^,X2, . . .Xj^)  for  which  the  H^;  = U2  “•••  ® 

intersects  the  boundary  of  the  ellipsoidal  region  given 
by  i*  . Since  in  the  case  where  Hq  is  true,  the  expres- 
sion for  the  ellipsoid  can  be  reduced  to  a quadratic  in 
the  common  mean,  say  u,  it  is  known  that 
Hq!  = U2  “•••  “ ellipsoidal  region  will 

intersect  if  and  only  if  the  discriminant  of  a quadratic  is 
non-negative,  indicating  real  roots.  It  should  be  em- 
phasized here  that  the  assumptions  underlying  the  ellip- 
soidal procedure  are  the  same  as  those  associated  with  the 
ANOVA.  These  are  additivity,  linearity,  normality,  in- 
dependence and  homogeneous  variances.  That  is,  the 
ellipsoidal  procedure  will  be  used  for  testing  the 


hypothesis  IIqI  " ^2  ™ on  independent  random 

■amples  from  normal  populations  with  the  usual  assumption 
of  homoscedasticity • The  development  begins  with  the 
symbolic  generalization  of  the  ANOVA,  k=2. 


ANOVA,  k=2 


2 (n,  - 1)S?  + (n,  - 1)S? 

Lst  Sp  - — i ± 1 £ 


» pooled  sample  variance 


where 


n^ExJ-dx^l^  _ n^EX^  - (Exp^ 

"ifni-D  n2(n2-l) 


Let  rx^ 
Then 


nj^Xj^;  1X2  = ^2X2;  rx^  + JIXj  = IX^ 
- n2(nj^Xj^)^  - nj^(n,X^)^ 


8(1? 


Therefore:  - 2,  , „^xf  * ,„, 

For  the  ANOVA  test  then: 


(l,n-2) 


<Jr  equivalently 


”1^1  *^2^2  “ (^1^1  ^ 


'1^1  ■*•  ''2^2^  /(n^+n^) 


(l,n-2) 


Sp  (nj^+n2  - 2)/(nj^+n2  “ 


Expanding  and  simplifying  ,(23)  results  in 


v2 


*'1*^2  ^^1  ” 


(l,n-2) 


(n^+n2)  s; 

an‘S  Hq;  a is  rejected  at  level  a if  P 
^(l,n-2, 1-a) 

ELLIPSOIDAL  PROCEDURE.  k=2 

The  ellipse  for  U2  is  given  by 
{X2  - ^2^^ 


(l,n-2) 


(13) 


(IM 


(15) 
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where 


2S^  f 

^(2,n-2,l-Y) 


^(2,n-2,l-Y) 


*2  " 


Expanding  results  in 


2 222  222 
a‘(5q  “ + V*2_)  + ~ ^‘^2^2  '*’  ^2^  ” ^1^2  "*  ® 


Letting  ■ 1*2  “ ^ say,  (17)  then  becomes 

—2  2 — 2 22  —2  2 — 2 22  22 
X^a2  - 2Xj^ya2  + U + X^a^  - 2Xj^Ua^  + U^a^  - a^a^  = 0 


2 2 2 — 2 — 2 —2  2 —2  2 2 "* 

(a^  + a2)^^  - (2Xj^a2  + 2X2af)M  + X^a^  + X^a^  - a^a;  » 0 


The  ellipse  given  by  (15)  and  the  line  = ^2  will 
intersect  if  and  only  if  the  discriminant  of  (19)  is 
non-negative . 

The  discriminant  of  (19)  is  given  by 

(— 2X^a2  “ 2X2a2^)  **  ^ (aj^  + a2)  (Xj_a2)  (X2^a2  + ^2^1  ” a2^a2)-i 


.1 


Therefore,  solving  for  ->  i results  in 

^(2,n-2,l-Y)  “ *^1  " 

Equating  and  (.m)  results  in 

*'(l,n-2)  ^"l  * "2^  ” ^(2,n-2,l-Y)  ^"l  * "2^ 


^(2,n-2,l-Y)  “ ^(l,n-2)/^  (25) 

From  the  form  of  and  (-.j)f  the  ellipsoidal 

confidence  region  test  will  bo  of  level  a,  and  hence 
the  same  test  as  (jj, ) if  f._  _ , , is  chosen  equal 

to  l/2fjj^  ^_2  ]^_a)  • ^or  this  choice,  the  ellipsoidal 
confidence  region  on  has  confidence  coefficient 

1-Y  ■ G(f,.  , „>/2)  where  G is  the  distribution 

function  of  the  F distribution  with  2 and  n-2  degrees  of 
freedom.  Thus,  the  confidence  coefficient  for  the 
ellipsoidal  confidence  region  is  the  probability  that  an 
F distributed  random  variable  with  2 and  n-2  degrees  of 
freedom  is  less  than  or  equal  to  1/2  the  100(l-a)th 
percentile  point  of  the  F distribution  with  one  and  n-2 
degrees  of  freedom. 


I 


ANOVA  (k  « 3) 


(nj^  - 1)S^  + (n2  - 1)S2  + (n^  - DS^ 


+ n2  “ 3 


where 


- 


n2(2:x^)  - u:<2)^ 


^2  - 


”2^"2  " 


- (1X3)^ 


^3  - 


n^Cn^  - 1) 


using  the  identical  algebraic  argument  as  for  k=2  case: 
(ixj  + EX2  + EX3)  = Sp  + n2  + - 3)  + 

n.X^  + n-X^  + n-X, 

/»c 


or  equivalently 

IX^  ■ Sp  (n^  + n2  + ~ 3)  + ^3^3 

The  generalized  ANOVA  test  statistic  for  k=3  can  now  be 


written  as 


(nj^X^  + n2X2  + n3X3)‘  I 

n.xj  * * „3x2 /, 

L n^  ■*■  n2  + n3  J 


(2,n-3) 


Sp  (n^^  + n2  + n3  - 3) 


After  simplification, reduces  to: 

P-  ..  - "l"2  - ^2)^  ♦ n^n3(Xj^  - 

(2,n-3)  , ~ 5 

(2)  (Oj^  + n2  + n^js 

^ (31) 

The  ANOVA  level-a  test  then  is  to  reject  Hq;  Uj^  « ■ U3 

If  (31)  is  greater  than  f,->  , , . 

^ * /n*"  3 , ) ; 

or  reject  Hq  if 


2 


'<2,n-3)  ^ ^(2,n-3,l-a) 


(32) 


Ellipsoidal  Procedure  (k=3) 

The  3”dimensional  ellipsoid  is  given  by 

‘*1  - '‘i^y4  * <5^2  - '‘2^y4  * (X3  - 

where 

•1  " ^ ^3,n  - 3,1  -Y)/n^ 

- 3 s2  f 

2 p (3,n  - 3,1  -Y)yn2 

*3  " ^ Sp  fp  _ 2,1  -Y)/n3 


- 1 

(33) 


(3M 


After  expanding  and  substituting 
^22^  becomes: 


3 - y say. 


1*2*3  * *1*3  *1*2*]  ~ [2a^a2xj^  + 23^3^72  + 2aia25:^j  U + 

[aja^xj  > aja^x^  ^ a^a^X^  - afa^a^]  . 0 


M 
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The  discriminant  of  the  quadratic  in  u given  by 


(35) 


is  equal  to 


Q . j^z^Zjj^  . , Qz^Z  * ^Z^Z  ^ ^Z^Q 

(}^3*(  * 4^l^\  * - ^^^|  - ° 


Again,  the  ellipsoid  given  by  (33)  and  Hq:  “ ^2  " ^^3 

will  intersect  if  and  only  if  (36)  is  non-negative. 
After  expanding  and  simplifying,  (36)  can  be  reduced  to 

-(4aja^a3)  (xj  - 2Xj^X2  + X^J  “ (4aja^a^)  (xj  - 2Xj^X3  + 

X3)  - (4aja2a3)  (X^  - 2X2X3  - X3)  + 4 (33^3333  + 


4 2 4 ^ 4 4 2. 


or  equivalently 

■■  X2)  ^ ^1^3  ^^1  ^ ^2^3  ^^2  * ^3^  * 


13  '1  3^ 


(3 ,n-3 , 1-Y) ®p 


Solving  for  f n-3,l-Y) 


— — 2 “““2 
n^n2  (X^  " ^2^  ^ " X^)  ^ ^2^3  ^^2  *"  ^3^ 


(3,n-3,l-Y) 


*1**3  '**1  3 * 


3 Sp  (nj^  + n2  + n3) 
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(2) 


Equating  (31)  and  (39)  we  obtain 
*(3,n-3,l-Y)  ®p  ‘"1  + ‘'2  " ^(2,n-3) 


Sp  (nj^  * n2  * 112) 


So  that 
£ 


{3,n-3,l-Y)  “ ^(2,n-3) 


(Ul) 


As  before,  from  the  forms  of  (31)  and  (Uo)  f the 
ellipsoidal  confidence  region  test  will  be  of  level  c 
and  hence  the  same  test  as  (32)  if  f^^  n-3  1-Y) 
chosen  equal  to  2/3  f,-  1 1 • For  this  choice,  the 

ellipsoidal  confidence  region  on  (Uj^,  has 

confidence  coefficient  1-Y  = G(2/3f^2  ^-3  1-a)  ^ ^ 

is  the  distribution  function  of  the  F distribution  with 
3 and  n-3  degrees  of  freedom.  Thus,  the  confidence  co- 
efficient for  the  ellipsoidal  confidence  region  is  the 
probability  that  an  F distributed  random  variable  with  3 
and  n-3  degrees  of  freedom  is  less  than  or  equal  to  2/3rds 
the  100 (1-0) th  percentile  of  the  F distribution  with  two 
and  n-3  degrees  of  freedom. 

For  arbitrary  k,  the  ANOVA  test  can  be  written 


il‘2 


.1  - Xj)^ 


(k-l,n-k) 


(Jc-l)Sp(n) 


(U2) 


c . 

u • 


1 


and  the  ellipsoidal  procedure  can  be  written 

_ 2 
- *j> 

*(k,n-k,l-lf)  (k)  (n)Sp 

It  can  be  seen  by  equating  {U2)  ^nd  (1,3)  that  a general 
expression  for  the  relationship  between  the  computed 
P statistic  for  the  ANOVA  test  and  the  statistic  for  the 
ellipsoidal  procedure  becomes 

^(k,n-k,l-Y)  " (3«-l)/(k)  (1*1*) 

Expression  suggests  that  the  ellipsoidal  confidence 

region  test  will  be  of  level  a,  and  hence  the  same  test 
as  the  ANOVA  level  a te~t  if  f is  chosen  equal 

to  (k-l)A  n-k  1-a)  * choice,  the  el- 
lipsoidal confidence  region  on  * • * 'l^k^  confi- 
dence coefficient  l-y  = G (k-1  f i-q)  ^ where  G is 

the  distribution  function  of  the  F distribution  with  k 
and  n-k  degrees  of  freedom.  Thus,  the  confidence  coef- 
ficient of  the  ellipsoidal  confidence  region  is  the 
probability  that  an  F distributed  random  variable  with  k 
and  n-k  degrees  of  freedom  is  less  than  or  equal  to 
(k-l)/k  times  the  100(l-a)th  percentile  of  the  F distribu- 
tion with  k-1  and  n-k  degrees  of  freedom. 
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Note  that  when  ■ N,  (1*2)  reduces 

to 


'(k-l,n-k)_  1<’‘1  - 


(k) (k-l)s: 


and  reduces  to 


^(k,n-k,l-Y)  ■ 


N r , (X.  - x.)^ 


K p 


(h5) 


(I46) 


Confidence  Coefficient  Deterniination 
A computer  was  used  to  calculate  tables  of  the 
critical  values  for  F and  the  confidence  coefficients. 
Picatinny  Arsenal  Mathematics/Scientific  Library  (M/SL) 
subroutines  were  utilized  initially  to  generate  an 
F,  . , „ table  for  six  levels  of  “ (.25,  .10,  .05, 

•02S,  .01,  .005)  with  k-1  (numerator  degrees  of  freedom) 
ranging  from  2 through  10  in  increments  of  1,  and  the  n-k 
(demoninator  degrees  of  freedom)  selected  to  correspond 
to  those  found  in  Table  A-7c  of  Dixon  and  Massey  (6) , 
namely  5,  10,  IS,  20,  24,  30,  40,  60,  120.  Once  this 
table  was  generated,  a subroutine  was  prepared  to  adjust 
each  F^  value  by  the  appropriate  factor  (k-l)/k.  These 
results  are  given  in  the  six  tables  which  are  labelled 
"Modified  F,  v Table  for  Use  With  the  Ellipsoidal 

Procedure".  Another  M/SL  subroutine  was  then  employed 
to  develop  the  remaining  six  tables  labelled  "1-y  Values 
VIhen  Using  the  Ellipsoidal  Procedure",  by  computing  the 
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GROUP  NU.'tDER 
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3_ 

4_ 
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64 

45 

42 

55 

61 

46 

39 

62 

50 

45 

45 

59 

55 

39 

43 

60 

56 

43 

41 

»0  " ^1  " 

U2  - W3  - li4 

X • 

58.4  X,  - 57.2 

X ■ 

43.6  X - 

1 

2 

3 

4 

»i " 

8.30  Sj  - 29.7 

7.8  sj  - 

“1 " 

■ N = 5 

; Sp  - 12.70;  k - 

*’(3,16) 

- N Z (X.  - x.)-^ 

i/j  ^ ^ 

k^  s2 
^ ®P 

5 

^58.4-57.2)^  + (58.4 

-43.6)^ 

+ (58.4-42)^ 

(57.2-43.6)^  + (57.2 

-42)^  + 

(43.6-42)^] 

(4)^(12.70) 

22.3425 


Critical  value  with  4,16  degrees  of  freedom,  to  equate 
ellipsoidal  test  with  an  ANOVA  (1-a)  » 0.95  test  ” 2.4. 
Because  22.34  > 2.4;  reject  “ '^3  " *^4 

Actual  y level  <■  0.90 
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MODIFIED  £,_  u - table  FOR  USE  WITH  THE  ELLIPSOID  PROCEDURE 
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"Everyone  feels  that  there  are  analogies  which  cannot  be  expressed  by  a 
formula,  and  that  they  are  the  most  valuable." 

Henri  Poincare 
Science  and  Method 


1.  Introduction.  In  1970,  it  was  established  conclusively  that  there 
does  not  exist  an  algorithm  for  solving  arbitrary  diophantine  equations, 
integer-programming  problems  or  discrete  optimizations.  Indeed,  this 
basic  result  quickly  yields  a strengthened  form  of  Gi'del's  second 
incompleteness  theorem:  for  any  consistent  axiomatic  number  theory,  there 
exists  a diophantine  equation  which  has  no  positive  integer  solution, 
but  such  that  this  statement  cannot  be  proved  within  the  framework  of  the 
given  axiomatization.  This  situation  adds  to  the  interest  and  importance 
of  special  algorithms  for  dealing  with  special  classes  of  diophantine 
problems.  But  another  basic  question  comes  to  mind;  to  what  extent 
are  general  algorithmic  methods  still  available  for  the  solution  of  broad 
classes  of  diophantine  problems  in  view  of  the  non-existence  of  an 
algorithm  for  all  diophantine  problems?  Indeed,  such  methods  would  be 
most  valuable  since  it  can  be  shown  that  there  does  not  exist  an  algorithm 
for  deciding  of  an  arbitrarily  given  diophantine  equation  whether  or  not 
it  has  any  prescribed  number  of  solutions  (e.g.,  one,  even,  odd  or  prime 
number  of  solutions). 

This  paper  shows  that  fixed-point  theory  is  applicable  to  existence 
problems  for  solutions  to  diophantine  equations,  diophantine  approximations 
and  diophantine  optimizations.  It  is  well  known  that  fixed-point  theory 
is  applicable  to  problems  for  the  existence  of  saddle  points  in  general 
game-theoretic  contexts  and  existence  problems  for  the  solutions  of 


877 


certain  classes  of  differential  equations  and  integral  equations.  By 
considering  common  fixed  lattice  points  for  coimiuting  families  of  continuous 
mapping  in  topolog  cal  spaces,  an  at-lthnctlijal  element  is  introduced  into 
functional  analysis  and  fixed-point  theory.  Then  jemr-al  techniques  from 
(functional)  analysis  which  are  supplementary  to  the  usual  theories  of 
entire  functions  or  meromorphic  transcendental  functions  (analytic  number 
theory)  are  available  for  the  solution  of  number- theoretic  problems  (e.g., 
diophantine  equations,  integer-programming  problems  and  discrete  optimiza- 
tions). Conversion  methods  from  diophantine  problems  to  fixed-Zaiticv- 
point  problems  are  given.  The  technique  for  the  determination  of  common 
fixed  laitije  points  for  families  of  continuous  mappings  is  applicable  to 
the  problem  of  the  existence  of  solutions  of  sveHfic-  non-linear  diophantine 
equations  of  Fermat  type,  Thue  type,  Skolem  type,  and  Mordell  type.  Only 
the  simplest  finite-dimensional  cases  are  considered.  Other  relations 
between  fixed-point  theory  and  lattice-packing  theory  will  be  developed 
elsewhere.  New  formal  relations  are  developed  between  (1)  fixed-point 
theory  and  extreme-point  theory  and  (2)  fixed-point  theory  and  Helly- 
type  theory. 

2.  Fixed-Point  Preliminaries.  Briefly,  we  discussed  two  of  the  simplest 
fixed-point  theorems  for  convex  sets.  These  are  used  and  extended  to 
diophantine  systems.  They  can  be  generalized  or  extended  in  several 
directions.  First,  the  so-called  Brouwer-Schauder-Tychonov  theorem  states 
that  if  C is  a compact  convex  set  in  a locally  convex  space  and  f is  a 
continuous  mapping  of  C into  C then  there  exists  ptC  such  that  f(p)  = p. 

As  noted  above,  this  theorem  has  many  applications;  another:  Suppose 

D is  a compact  subset  of  Hilbert  space  H.  Then  D is  convex  iff  for  each 
point  of  H there  exists  a unique  nearest  point  of  0.  Further,  this 
important  fixed-point  theorem  has  ecn^tvuetive  versions  thereby 
facilitating  the  construction  of  solutions  of  various  operator  equations. 

Secondly,  the  so-called  Markov-Kakutar i theorem  states  that  if  C is 
a compact  convex  subset  of  a linear  topological  space  (■..'.*  necessarily 
locally  convex!)  and  if  F is  a non-empty  conmuting  family  of  affine 
continuous  mappings  of  C into  C then  there  exists  ptC  such  that 
f(p)  = p for  all  ffF.  It  can  be  used  in  functional  analysis  to 
establish,  among  other  results,  the  existence  of  invariant  means  on 
commutative  groups. 

3.  New  Fixed-Point  Results.  We  extend  an  important  case  of  results  by 
K.  Is^ki  [l]  on  common  fixed  points  for  contractive  mappings  to  conmon 
fixed  lattice  points  for  KCK-exi'enie^ive  mappings  [2].  Recall  that 
non-expansi ve  mappings  include  contractive  mappings,  orthogonal 
projections,  and  isometries.  Note  that  a fixed  point  of  a non-expansive 
mapping  need  net  be  unique  (consider  either  the  reflection  of  a closed 
disc  about  one  of  its  diameters  or  the  identity  mapping).  It  will  be 
basic  to  the  present  inquiry  to  investigate  the  mathematical  .t.-.-'v 
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of  the  set  of  all  common  fixed  points  for  communting  families  of 
various  continuous  functions.  For  simplicity,  in  theorem  1,  we  consider 
only  finite-dimensional  inner-product  spaces  and  study  the  set  of  all 
common  fixeu  points  looking  for  a common  fixed  latti^'c  point.  It  is 
here  that  we  combined  the  geometry  of  numbers  and  fixed-point  theory  [3] 
[4]. 


Theorem  1 . Let  be  an  n-dimensional  Euclidean  space  with 
origin  9.  Let  B be  a bounded  closed  convex  subset  of  E^.  Let  C be  a 
non-empty  commuting  family  of  non-expans ive  mappings  of  B into  B.  If 
the  (convex)  body  F of  all  conrion  fixed  points  over  C is  disjoint  with 
e and  contains  a ball  B^  with  Lebesgue  measure  p(b1)  ^ 2^/^  (n/2  + 1) 
then  F contains  a conmon  fixed  lattCar  point  p ^ o. 

Note  1 : If  the  body  F is  centrally  syimetric  about  ti  (hence  o iF)  and 
with  Lebesgue  measure  i](F)  ^ 2^^  then,  triviulhj,  F contains  a common 
fixed  lattice  point  ptB  with  relatively  prime  coordinates;  thus, 
p ^ 0.  Note  2:  Theorem  1 can  be  generalized  to  Minkowski  spaces 
but  without  guarantee  that  F is  convex. 

Proof:  For  each  non-expansi ve  mapping  M in  C,  the  set  of  all  fixed 
points  is  non-empty  (F.  E.  Browder),  convex  (since  B is  convex,  E'’  is 
strictly  convex,  and  M is  non-expansi ve) , closed  (continuity  of  M);  thus, 
it  is  even  compact.  Hence,  by  commutativity  of  C and  induction,  finite 
intersections  over  C of  sets  of  fixed  points  is  non-empty,  convex 
and  compact.  Since  B is  compact,  the  intersection  over  C of  all  sets  of 
fixed  points  is  non-empty,  convex,  and  compact.  Now  apply  Blichfeldt's 
theorem  (or  in  the  case  of  Note  1,  Minkowski's  theorem)  on  the  existence 
of  lattice  points  in  aonvrx  bodies  [5].  QED 

Next,  we  give  a common-fixed-Lattice-point  extension  of  a result 
by  A.  A.  Markov  [6]  and  S.  Kakutani  [7]  for  topological  vector  spaces. 
Once  again,  for  simplicity,  we  consider  only  the  finite  dimensional 
case  and  study  the  set  of  all  common  fixed  points  looking  for  a common 
fixed  Lattice  point. 

Theorem  2:  Let  L^  be  an  n-dimensional  linear  topological  space 
with  origin  n.  Let  S be  a compact  convex  subset  of  Li^.  Let  C be 
a non-empty  commuting  family  of  affine  continuous  mappings  of  S into 
S.  If  the  (convex)  body  F of  all  common  fixed  points  over  C is  disjoint 
with  9 and  contains  a ball  B with  Lebesgue  measure  ii(B)  ^ 2'’/2(n/2  + 1) 
then  F contains  a common  fixed  lattice  point  q / o. 

Note  1 : If  the  body  F is  centrally  symmetric  about  9 and  with 
Lebesgue  measure  n(F)  ^ 2'^  then,  trivially,  F contains  a comiTOn  fixed 
lattice  point  qcS  with  relatively  prime  coordinates;  thus  q t 9. 


Proof:  For  each  affine  continuous  mapping  M in  C,  the  set  of  all 
fixed  points  is  non-empty  (Markov-Kakutani ) , convex  (since  M is  affine), 
and  closed  (continuity);  thus,  it  is  even  compact.  Hence,  by  cottmutati vity 
of  C and  induction,  any  finite  intersection  over  C of  sets  of  fixed  points 
is  non-empty,,  convex,  and  compact.  Since  S is  compact,  the  intersection 
over  C of  all  sets  of  fixed  point  is  non-empty,  convex,  and  compact.  As 
before,  apply  Blichfeldt's  theorem  or  for  Note  1,  Minkowski's  lattice 
point  theorem.  QEO 

Before  proceeding  further,  we  make  five  observations.  First, 
the  results  so  far  weld  together  four  basic  kinds  of  notions:  geometric 
(convexity,  symmetry,  affineness,  and  Lebesgue  measure),  arithmetical 
(lattice  points  and  integers),  algebraic  (linear  space),  topological 
(compactness,  continuity,  and  topological  space).  Secondly,  techniques 
which  establish  the  constructive  existence  of  fixed  points  entail 
techniques  for  the  constructive  existence  of  solutions  to  non-linear 
diophantine  equations.  Thirdly,  it  should  be  clear  that  a whole 
species  of  theorems  like  theorems  1 and  2 exist  in  which  one  "mixes"  the 
types  of  mappings  used  or  allows  one  of  the  continuous  mappings  to  be 
non-affine  in  Theorem  2 or  non-non-expansi ve  in  Theorem  1.  Of  course, 
then,  it  need  not  follow  that  the  non-empty  set  of  all  common  fixed 
points  is  convex.  Fourthly,  Theorems  1 and  2 are  identical  for  Euclidean 
spaces  when  all  mapping  under  consideration  are  isometries  (an  isometry 
is  a special  case  of  both  an  affine  mapping  and  a non-expansi ve  mapping). 
Lastly,  Theorems  1 and  2 provide  a precise  sense  in  which  there  are 
qualitative  methods  in  number  theory  or  topological  methods  in  number 
theory. 

4.  Conversion.  Fixed-point  methods  are  already  known  to  be  useful 
for  solving  non-linear  differential  equations  and  integral  equations. 

The  following  is  a general  technique  for  reducing  an  existence  problem 
for  a non-linear  diophantine  equation  to  a fixed-point  problem: 

Suppose  F(x,y)  is  any  real  algebraic  form  linear  in  x.  Consider  the 
linear  relation  F(x,y)  = 0.  Suppose  it  has  a unique  solution  x = Gy  for 
each  y in  some  set  S of  a real  vector  space.  Then  a lattice-point 
solution  in  S of  F(x,  x)  - 0 is  logically  equivalent  to  the  existence  of 
a fixed-lattice-point  in  S for  the  mapping  G.  I.  e,  the  existence  of 
solutions  of  a specific  non-1 inear  diophantine  equation  can  be  determined 
by  means  of  the  existence  of  a fixed-lattice-point  for  a transformation 
associated  with  a more  general  linear  diophantine  equation.  E.  g., 
given  the  non-linear  diophantine  equation 

l+xi+x?+x^+xf-x2  = 0.  Convert  to  l+xi+xiyi+xiy^+x^y^-x2y2  = 0. 

Define  continuous  G : E^-*- E^  so  that  = G(y).  Then  two  fixed-lattice 
points  of  G are 

(0,  1)  and  (3,  11) 

which  are  solutions  of  the  given  diophantine  equation.  Note  that  the 
second  solution  consists  of  distinct  prime  numbers  alone. 
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We  point  out,  again,  that  the  solution  of  the  original  non-linear 
problem  was  obtained  by  solving  a more  general  linear  problem.  Hence 
we  have  a clear  sense  in  which  it  is  incorrect  to  depreciate  the  value  of 
linear  problems  by  extolling  the  apparent  flexibility  and  range  of 
non-linear  problems.  Rather  we  need  to  understand  even  more  general 
linear  problems  in  arbitrarily  many  variables  and  arbitrarily  high  degree 
in  damtij  variables.  It  would  seem  that  progress  in  the  study  of 
general  systems  has  been  more  on  the  side  of  the  introduction  of  new 
fundamental  invariance  relations  than  on  investigations  of  the  ncgationa 
of  well  known  ones. 

In  closing  we  note  that  this  technique  applied  to  the  qiudratie 
case  of  Fermat's  Theorem,  x2+y2  _ 22  = q,  results  in  a purely  linear 
problem  with  infinitely  many  solutions. 

5.  Common  Fixed  Extreme  Points  and  Exposed  Points.  Instead  of  checking 
fixed-point  sets  for  the  existence  of  lattice  points,  we  turn  to  the 
problem  of  checking  fixed-point  sets  for  the  existence  of  extreme  points 

[8]  [9]  or  exposed  points  [8]  [10].  Recall  that  if  f is  a concave  C 

function  and  C is  compact  then  f attains  a minimum  at  an  extreme  point 

of  C.  Further,  if  C is  convex  as  well,  the  extreme  points  of  C form  u 

the  smallest  set  by  means  of  which,  using  only  convex  combinations,  • 

all  points  of  C can  be  approximated.  The  relation  of  extreme  points  to 
linear  progranriing  is  clear;  in  looking  for  an  optimal  solution  we 
need  only  search  the  extreme  points.  More  specifically,  a feasible 

solution  of  a LP  corresponds  to  an  extreme  point  iff  it  is  basic.  I ) 

•'J 

By  way  of  review,  we  point  out  that  extreme  points  depend  on  the  I 

linear  structure  of  the  underlying  space  but  not  on  its  topology.  On  f . 

the  other  hand,  exposed  points  depend  on  the  linear  structure  of 
the  underlying  space  and  on  the  topology  of  the  space  (the  topology  of 
the  space  determines  the  size  of  the  conjugate  space). 

I 

Theorem  3.  Let  S be  a compact  convex  subset  of  locally  convex 
topological  vector  space.  Let  C be  a non-empty  commuting  family  of 
affine  continuous  mapping  of  S into  S.  Let  F be  the  (non-empty)  set 
of  all  common  fixed  points  over  C.  Then  F contains  all  extreme 
points  of  S iff  C = UsK  where  I5  is  the  identity  mapping  on  S. 

Proof:  By  Markov-Kakutani  F is  non-empty,  convex  and  compact.  The 
"if"  direction  is  trivial  since  S is  compact  and  convex.  The  "only  if" 
direction  follows  from  the  important  theorem  of  KreTn-Mil'man  by  using 
the  convexity  of  F:  if  S is  a compact  convex  subset  of  a locally  convex 
space  and  if  Fcrs  then  S is  equal  to  the  closed  convex  hull  of  F iff 
the  closure  of  F contains  all  extreme  points  of  S.  QED 
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Of  course,  another  basic  question  here  is:  determine  necessary 
and  sufficient  conditions  on  C so  that  F contains  at  least  one,  but 
not  all,  extreme  points  of  S.  Such  conditions  require  some  kind  of 
restriction  since  F may  not  contain  any  extreme  point  of  S although 
S must  necessarily  contain  an  extreme  point. 

The  next  result  is  notable  since  it  does  not  require  compactness. 

It  cannot  be  generalized  from  Hilbert  spaces  to  Banach  spaces 
for  at  least  tuo  reasons:  although  the  fixed-point  set  F is  non-empty 
and  convex  in  Hilbert  space,  (1)  F may  be  empty  in  Banach  space  and 
(2)  F may  not  be  convex  Banach  space. 

Theorem  4:  Let  B be  a bounded  closed  convex  subset  of  Hilbert  space. 
Let  C be  a non-empty  commuting  family  of  non-expansi ve  mappings  of  B 
into  B.  Let  F be  the  (non-empty)  set  of  all  conmon  fixed  points  over  C. 
Then  F contains  a!’  extreme  points  of  B iff  C = (Igl. 

Proof:  By  F.  E.  Browder  and  others,  F is  non-empty,  convex,  and 
weakly  compact.  As  before,  the  "if"  direction  is  trivial.  The  "only 
if"  direction  follows  from  an  extension  of  the  KreTn-Mil'man  theorem 
for  certain  non-compact  sets.  QED 

As  before,  another  basic  question  is:  determine  N&S  conditions  on 
C so  that  F contains  at  least  one,  but  not  all,  extreme  points  of  B. 

Of  course,  F will  always  have  its  own  extreme  points,  but  they  may  not 
be  extreme  points  of  B;  similarly  in  Theorem  3 with  "B"  replaced  with 


In  closing  this  section,  we  note  that  Theorem  4 is  nearly  trivial 
when  "bounded  closed"  is  replaced  with  "compact".  Even  so,  a satisfactory 
generalization  to  Banach  spaces  isn't  available,  since  then  F may  not  be 
convex  although  F is  non-empty.  Further,  Theorems  3 and  4 remain 
valid,  if  one  replaces  "extreme  points"  with  "exposed  points".  We 
point  out  that  the  ideas  of  this  section  are  applicable  to  modern  potential 
theory  and  barycentric  measure- theory  as  well  as  to  the  problem  of  the 
extremal  structure  of  fixed-point  sets.  Finally,  we  point  out  the 
possibility  of  an  exceptionally  strong  type  of  fixed  point,  a coiirton 

fixed  extreme  lattice  point  for  a family  of  mappings.  Clearly,  there  is 
a non-empty  class  of  Integer  Linear  Programs  for  which  the  integer 
constraints  turn  out  to  be  superf louous . This  class  is  characterized  by 
the  property  that  a.’:  extreme  points  of  the  corresponding  Linear  Program 
are  lattice  points.  However,  if  the  corresponding  LP  has  non-lattice 
extreme  points  then  the  integer  constraints  entail  additional  linear 
constraints.  Although  it  is  sufficient  to  generate  the  convex  hull 
associated  with  the  feasible  lattice  points,  it  is  not  necessary;  indeed, 
it  is  often  inefficient.  It  suffices  to  make  the  optimal  integer 
solution  an  .u-fci'm,’  point  and  all  non-lattice  extreme  points  with 

a more  suitable  objective- function  value. 


6.  A New  Kind  of  Fixed-Point  Theorems.  It  is  well  known  that  fixed- 
point  theory  can  be  used  to  provide  quick,  if  not  simple,  proofs  of 
Helly's  Theorem.  On  the  other  hand,  there  exist  several  simple  proofs 
of  Helly's  Theorem  [8]  that  make  no  use  of  fixed-point  theory.  Thus, 
one  is  led  to  the  tantalizing  question:  can  Helly's  Theorem  (whose 
proof  does  not  depend  on  fixed-point  theory)  be  used  to  establish 
new  kinds  of  fixed-point  results?  Of  course,  it  is  hoped  that  a few 
of  the  new  kinds  of  fixed-point  results  would  be  dimension- free.  We 
give  proofs  for  two  new  results  on  relations  between  combinatorial 
geometry  and  fixed-point  theory  discussed  elsewhere  without  proof  [11] 
[12].  These  discussions  treat  what  can  be  called  fixed-point-extension 
theorems.  I.e.,  common  fixed  pointsx^  (iel)  over  certain  families 
(iel)  of  continuous  mapping  can  be  used  to  establish  the  existence  of 
a common  fixed  point  y over  a broader  family  B of  continuous  mappings. 
Here,  "broader"  is  used  in  the  strong  substantive  sense  that 
B U-jei  F,  and  "common  fixed  point"  is  used  in  the  sense  of  a fixed 
point  aommon  to  several  mappings. 

Theorem  5:  Let  {Sf  : feF}  be  a non-empty  family  of  compact  convex 
subsets  of  E^.  Let  {C^  : feF}  be  a class  of  non-empty  commuting 
families  of  non-expansi ve  mappings  from  Sf  into  Sf,  fcF.  If  each 
(n  + 1)  or  fewer  members  of  {Sf}  have  some  fixed  point  over  some  members 
of  {Cf}  in  common  then  all  members  of  {Sf}  have  some  fixed  point  over 
all  members  of  {Cf}  in  common. 

Proof:  For  each  pair  Sf,  Cf  (feF),  the  set  Kf  of  all  common  fixed 
points  over  Cf  is  non-empty  (by  hypothesis  which  is  consistent  with 
BroiWer's  Theorem),  convex  (since  E'’  is  strictly  convex  and  acts  through 
a non-expansive  mapping),  and  compact  (by  continuity  and  convexity). 

Now,  apply  Helly's  Theorem  to  these  compact  convex  subsets  Kf  ^ Sf  of 
common  fixed  points  over  Cf.  Hence  all  members  of  {Kf}  have  some  point 
pe  ^ fj-p  Kf  in  common;  a universal  common  point.  But  the  universal 
point  p is  a common  fixed  point  over  the  family  U f^p  Cf.  QED 

Theorem  6:  Let  {Tf  : feF}  be  a non-empty  family  of  compact  convex 
subsets  of  an  n-dimensional  linear  topological  space. 

Let  {Df  : fcF}  be  a class  of  non-empty  commuting  families  of  affine 
continuous  mappings  of  Tf  into  Tf,  feF.  If  each  (n  + 1)  or  fewer 
members  of  {Tf}  have  some  fixed  point  over  some  members  of  {Df}  in 
common  then  all  members  of  {Tf}  have  some  fixed  point  over  all  members 
of  {Df}  in  common. 

Proof:  For  each  pair  Tf,  Df  (feF),  the  set  Lf  of  all  common  fixed 
points  over  Df  is  non-empty  (by  hypothesis  which  is  consistent  with  the 
Markov-Kakutani  Theorem),  convex  (since  the  mappings  are  affine),  and 
compact  (by  continuity  and  convexity).  As  in  Theorem  5,  apply 
Helly's  Theorem  to  the  compact  convex  subsets  Lf  c Tf.  Hence  there 
exists  a universal  point  qe  fj.pLp  such  that  q is  a common  fixed 
point  over  the  family  Lyfg.p  Df.  QED 
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In  closing  this  section,  we  note; 


(1)  Each  of  the  Theorems  5 and  6 can  be  used  any  place  Helly's 
Theorem  is  used  since  each  reduces  to  Helly's  Theorem  when  the  confuting 
families  are  identity  mappings. 

(2)  Each  of  the  Theorems  extends  a common  point  result  for  a family 
of  sets  to  a conmon  fixed  point  result  over  a family  of  mappings. 

(3)  It  is  known  that  Helly's  Theorem  holds  in  any  Minkowski  space. 
However,  Theorem  5 does  n,  : generalize  to  arbitrary  Minkowski  space 
(the  fixed-point  sets  needn't  be  convex),  but  Theorem  6 is  most  useful 
in  any  Minkowski  space. 

(4)  Other  relations  between  fixed-point  theory  and  combinatorial 
geometry  are  given  in  [13].  Note  that  Lemma  2 of  [13]  is  a double 
generalization  of  Helly's  Theorem. 

7.  Stochastic  Fixed-point  Analogues.  In  closing  this  paper,  we  turn 
to  a brief  discussion  of  relations  between  stochastic-operator  theory 
and  fixed-point  theory,  i.e.,  between  operator  valued  measurable  functions 
and  fixed-point  theory.  The  purpose  of  this  approach  is  two-fold; 

(1)  greater  apparent  generality  and  (2)  to  include  probabilistic  features 
as  a preliminary  step  to  establishing  relations  between  fixed-point 
theory  and  fuzzy-sets  theory.  Theorem  7 is  a stochastic  analogue  of 
the  Markov-Kakutani  Theorem  in  Euinach  spaces.  It  depends  on: 

Lemma.  Let  C be  a compact  convex  subset  of  a Banach  space. 

Let  fluy  be  a continuous  random  operator  from  C into  C.  Then  there 
exists  a C-valued  measurable  function  f(uO  such  that  T(w)  f(io)  = f(„0  a.s.. 

Proof:  Clear.  (The  only  difficult  part  is  establishing  the 
measurability  of  the  fixed-point  f(.)). 

This  Lemma,  which  can  be  generalized,  can  be  used  to  establish  the 
existence  of  solutions  of  non-linear  differential  equations  and 

integral  equations. 

Theorem  7.  Let  S be  a compact  convex  subset  of  a Banach  space. 

Let  C be  a non-empty  coninuting  family  of  affine  continuous  random 
operators  T (m)  from  S into  S.  Then  there  exists  a conmon  fixed 
S-valued  random  variable  over  C;  i.e.,  there  exists  an  S-valued 
random  variable  f(ui)  such  that  T(ui)  f(u)  = f(io)  a.s.  for  every 
T(u>)  rC. 

Proof:  Apply  the  Lemma  and  follow  the  proof  for  the 
Markov-Kakutani  Theorem;  as  before  measurability  of  f is  difficult  to 
show. 


B8.', 


References 


[1]  K.  Iseki,  On  common  fixed-point  theorems  of  mappings, 

Proc.  Japan  Acad.  50  (1974),  468-469. 

[2]  F.  E.  Browder,  Nonlinear  operators  and  nonlinear  equations  of 
evolution  in  Banach  spaces,  Vol  II,  Amer.  Math.  Soc.  (1976). 

[3]  A.  A.  Mullin,  Applications  of  functional  analysis  to  number 
theory.  Notices  Amer.  Math.  Soc.  23  (Aug.,  1976),  A-483. 


[4]  A.  A.  Mullin,  More  on  common  fixed  lattice  points  for  families 
of  mappings.  Notices  Amer.  Math.  Soc.  23(Oct.,  1976),  A-578. 

[5]  E.  Hlawka,  Topics  in  the  theory  of  numbers,  California  Institute 
of  Tech.  (1967) , 124  pp. 

[6]  A.  A.  Markov,  Quelques  theoremes  sur  les  ensembles  abeliens, 

CR  Acad.  Sciences  URSS  (N.  S)  1 (1936),  311-313. 

[7]  S.  Kakutani,  Two  fixed-point  theorems  concerning  bicompact  convex 
sets,  Proc.  Imperial  Acad.  Tokyo  14  (1938),  242-245. 

[8]  F.  A.  Valentine,  Convex  Sets,  New  York  (1976)  238  pp. 

[9]  A.  A.  Mullin,  On  conrion  fixed  extreme  points  for  families  of 
mappings.  Notices  Amer.  Math.  Soc.  24  (April,  1977),  A291-292. 

[10]  A.  A.  Mullin,  On  common  fixed  exposed  points  for  families  of 
mappings.  Notices  Amer.  Math.  Soc.  24  (Oct.,  1977). 

[11]  A.  A.  Mullin,  Query  105  (Fixed-point-extension  theorem).  Notices 
Amer.  Math.  Soc.  23  (Oct.,  1976),  pg.  365. 

[12]  A.  A.  Mullin,  Relations  between  fixed-point  theory  and  combinatorial 
geometry.  Notices  Amer.  Math.  Soc.  24  (Jan.,  1977),  A-9. 


[13]  A.  A.  Mullin,  On  imbrication  theory.  Notices  Amer.  Math.  Soc. 
24  (June,  1977),  A-378. 


r 


TITLE:  Rank  Ordering  of  Laboratory  Projects  under  Elastic  Constraints: 

A Fuzzy  Subsets  Approach 

AUTHOR : Dr.  Harold  Y.  H.  Law 

Advanced  Systems  Technology  and  Integration  Office 
US  Army  Aviation  Research  and  Development  Command 
St.  Louis,  Missouri  63166 

ABSTRACT : One  important  role  in  the  management  of  a research  and 
development  organization  is  the  selection  and  support  of  research  and 
development  projects  under  limited  resources  to  effect  a balanced  program 
and  to  achieve  the  desired  objectives.  Two  major  constraints  in  the 
selection  process  considered  in  this  study  are  the  project  cost  growth 
and  schedule  slippage.  There  may  be  .additional  constraints  such  as 
performance,  etc.  Often  such  constraints  are  not  well-defined  and  are 
elastic,  retlecting  the  decision  maker's  preference  and  the  need  at  the 
time.  As  part  of  the  selection  process,  the  constraints  are  compared  and 
the  projects  ranked  to  provide  a scoring  for  selection.  In  this  paper, 
an  approach  through  the  theory  of  fuzzy  subsets  is  presented  to  provide 
an  orderly  and  consistent  procedure  to  handle  the  elastic  (fuzzy)  nature 
of  the  constraints  and  to  rank  order  the  research  and  development 
projects  under  a fuzzy  environment.  Tiie  result  of  such  rank  ordering 
also  provides  a rational  basis  for  a constraint  trade-offs  study,  wtiich 
i^i  is  an  important  exercise  in  a search  for  viable  alternatives  and  in 

budget  allocation.  It  is  hoped  that  continued  effort  in  the  study  and 
application  of  fuzzy  subsets  will  lead  to  useful  support  of  mllitarv 
resource  allocations  in  the  years  to  come. 
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RANK  ORDERING  OF  LABORATORY  PROJECTS 
UNDER  ELASTIC  CONSTRAINTS:  A FUZZY  SUBSETS  APPROACH 


Dr.  Harold  Y.  H.  Law 

Advanced  Systems  Technology  and  Integration  Office 
US  Army  Aviation  Research  and  Development  Command 
St.  Louis,  Missouri 


INTRODUCTION 

The  mathematical  research  efforts  in  the  US  Army  Aviation  Research  and 
Development  Command  (AVRADCOM)  are  directed  primarily  to  the  general  domain 
of  aerodynamics,  propulsion,  structures  and  decision  analysis.  The  end 
results  of  these  efforts  contribute  to  fill  the  technological  needs 
and  requirements  of  advanced  airmobile  systems. 

Decision  risk  analysis,  a portion  of  the  basic  mathematical  research 
efforts,  is  a subject  which  has  been  under  continual  development  and 
refinement,  and  it  has  applied  to  various  systems  and  programs  within 
AVRADCOM  and  her  Laboratories  [1].  A significant  accomplishment  is  the 
development  of  two  algorithms  [2]:  cost  impact  and  schedule  variance. 

These  algorithms  are  technically  based  in  that  the  data  to  exercise  the 
algorithms  are  collected  from  a technical  risk  assessment.  The  methodology 
not  only  allows  the  proper  integration  of  technical  aspects  to  cost  and 
schedule,  but  also  presents  outputs  accommodating  "what  if"  types  of 
questions.  In  particular,  potential  cost  growth  and  schedule  slippage 
consideration  are  exhibited,  which  provide  a balanced  appraisal  for 
decision  making. 

These  algorithms  and  risk  approach  were  also  applied  to  the  project 
selection  process  [3]  by  highlighting  the  probable  cost  and  schedule 
impacts.  Based  on  the  cost  and  schedule  impact  information,  the  decision 
maker  is  to  compare  and  select  the  projects  that  are  considered  viable  to 
achieve  the  set  objectives.  This  paper  mainly  addresses  to  the  concepts 
and  techniques  of  making  such  selection. 

DECISION  ENVIRONMENT 

Much  of  the  decision  making  in  project  selection  takes  place  in  an 
environment  in  which  the  goals,  the  constraints,  and  the  consequences  of 
possible  actions  are  not  known  precisely.  For  example,  the  condition  to 
select  a particular  project  may  be  that: 

a.  The  acceptable  cost  growth  should  be  ^ the  range  of  1 to  2 million 
dollars . 


[ ] indicates  references . 


b.  Tlie  maximum  allowable  schedule  delay  should  not  be  significant ly 
lonRer  than  12  months. 

c.  The  probability  of  success  of  the  project  should  be  about  0.8  or 
better . 

In  the  above  examples,  the  sources  of  fuzziness  and  imprecision  are  the 
underlined  words  of  phrases.  In  addition,  there  is  always  the  "wtiat  if" 
type  of  question  that  the  decision  makers  can  ask  and  should  ask.  The 
irapreclsed  goals  and  constraints  and  the  "what  if"  type  of  questions  are 
not  random  or  statistical  in  nature.  They  are  the  result  of  fuzziness  and 
imprecision  of  the  criteria  of  selection.  In  this  study,  the  fuzziness 
arises  from  the  elastic  nature  of  cost  growth  and/or  schedule  delay  as 
prefer renced  by  the  decision  maker  and  the  need  at  the  time. 

Since  the  imprecisions  are  not  random  and  statistical  in  nature,  the 
problems  should  not  be  handled  by  the  probabilistic  approach  and  treated 
as  if  they  were  stochastic.  The  nature  of  this  problem  can  be  more 
properly  handled  by  the  postulate  of  an  approach  [4]  wliich  revolves  around 
the  theory  of  Fuzzy  Sets  [5]. 

PURPOSE  f\ND  SCOPE 

The  purpose  of  this  paper  is  to  describe  briefly  the  concept  of  Fuzzy 
Subsets,  to  illustrate  the  usefulness  of  this  concept  in  the  context  of 
project  selection,  and  to  suggest  a technique  to  help  quantify  explicitly 
the  imprecised  goals  and  constraints.  This  quantification  leads  to  rank 
in  order  the  cost,  schedule  and  perhaps  performance  and  other  impacts  in 
a systematic,  consistent  and  automatic  manner  in  order  to  provide  a 
rational  and  orderly  basis  for  selection  of  projects. 

ELEMENTS  OF  TOE  THEORY  OF  FUZZY  SETS 

The  concept  of  fuzzy  sets  was  first  introduced  by  Professor  L.  A.  Zadeh 
[5]  in  1965  to  deal  with  classes  of  objects  encountered  in  the  real 
physical  world,  wliich  do  not  have  precisely  defined  criteria  of  membership. 

The  theory  of  fuzzy  sets  is  a body  of  concepts  and  techniques  for  dealing 
in  a systematic  way  with  classes  whose  boundaries  are  not  sharply  defined 
and  in  which  an  object  may  have  a grade  of  membership  intermediate  between 
full  membership  and  nonmembership.  The  principal  motivation  for  this  theory 
rests  on  the  premise  that  much  of  human  thinking  involves  the  manipulation 
of  fuzzy  rather  than  nonfuzzy  sets  and  is  approximate  rather  than  precise 
in  nature. 


The  definition  of  fuzzy  sets  and  their  operations  within  the  realm  of 
decision  making  will  be  summarized  in  this  section.  However,  before  we  go 
on  to  do  so,  it  is  necessary  to  distinguish  between  r.andomness 
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and  fuzziness.  Essentially,  randomness  has  to  do  with  uncertainty 
concerning  membership  or  nonmembership  of  an  object  in  a nonfuzzy  set. 
Fuzziness,  on  the  other  hand,  has  to  do  with  classes  in  which  there  may 
be  grades  of  membership  intermediate  between  full  membership  and 
nonmembership.  The  notion  of  a fuzzy  set  is  nonstatistical  in  nature. 

To  Illustrate  the  point,  the  fuzzy  assertion  "Today's  weather  is  fine" 
is  imprecise  by  vlrture  of  the  fuzziness  of  the  term  "fine."  On  the 
other  hand,  "The  probability  that  it  will  rain  today  is  0.7"  is  a 
probabilistic  statement  concerning  the  uncertainty  of  the  occurrence  of 
a nonfuzzy  event  (rain). 

Informally,  a fuzzy  set  is  a class  of  objects  in  which  there  is  no  sharp 
boundary  between  those  objects  that  belong  to  the  class  and  those  that  do 
not.  A more  precise  definition  may  be  stated  as  follows: 

Definition : Let  X = (x)  denote  a collection  of  objects  denoted 

genetically  by  x.  Then  a fuzzy  subset  A in  X is  a set  of  ordered  pairs: 

A = {(x,Ua(x)))  , for  all  x in  X,  (1) 

where  U;^(x)  is  termed  the  grade  of  membership  of  x in  A,  and  M is  a 

function  from  X to  a space  M called  the  membership  space.  When  M contains 
only  two  points,  0 and  1,  A is  nonfuzzy  and  its  membership  function  becomes 
identical  with  the  characteristic  function  of  a nonfuzzy  set. 

Example: 

Let  X = {xj,  X2,  X3,  X4}  be  a set  of  costs  (in  million  dollars)  of 
research  projects,  such  that 

X = { 2,  3,  4,  5}  . 

Then  a fuzzy  subset  A,  such  that  X is  approximately  3.6  million  dollars, 
could  subjectively  be  given  by 

A=  {(0.5/2),  (0.8/3),  (0.9/A),  (0.6/5))  . 

Equality : Two  fuzzy  sets  are  equal,  A = B,  if  and  only  if 

U^(x)  = Ug(x)  for  all  x in  X. 

Empty : Fuzzy  set  A is  said  to  be  empty  if  and  only  if  Ua(x)  = 0 for  all 
X in  X. 

Containment : A fuzzy  set  A Is  contained  in  or  is  a subset  of  a fuzzy  set  B, 
written  as  A'=  B,  if  and  only  if  ^ 
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Alternatively,  this  relation  may  be  represented  as  a relation  matrix: 


John 

Jim 

Tom 

0.8 

0.6 

Dick 

^0.2 

0.9  _ 

in  which 

X and  the 

the  (i,j)'^’' 
j*-"  value 

element  is  the  value  of  U (x,y)  for  the 
of  y . 


i^^’  value  of 


SIMPLE  DECISION  MAKING  UNDER  FUZZY  SUBSETS 

Let  X = { X } be  a given  set  of  alternatives.  Also  let  G = {Gj,  G2 , G^^} 

be  a set  of  n fuzzy  goals  in  the  space  of  alternatives  X,  and 
C ” {Cj,  C2,  . . . , Cjj  } be  a set  of  m fuzzy  constraints  also  in  the 
space  of  alternatives  X.  Then  a decision  D is  the  intersection  of  the 
goals  Gj^,  G2,  Gj^  and  the  constraints  Cj^,  C2,  C^,.  The  decision 

membership  function  is: 

UpCx)  = Min  (Uq^(x),  ....  Uq^(x),  U(>^(x) Uq^(x)).  (4) 

In  the  above  fuzzy  decision  D,  we  are  assuming  that  all  of  the  goals  and 
constraints  are,  in  a sense,  of  equal  importance.  There  are  some  situations 
in  which  some  of  the  goals  and  perhaps  some  of  the  constraints  are  of 
greater  importance  than  others.  In  such  cases,  D might  be  expressed  as  a 
convex  combination  of  the  goals  and  the  constraints,  with  the  weighting 
coefficients  reflecting  the  relative  importance  of  the  constituent  terms. 

More  explicitly,  we  may  express  Uj5(x)  as: 


n m 

= I B.Uc  (x) 

i=l  ^ i=l  ^ 


where  and  are  constants  such  that: 


n 

V 0 

i=l 


[ ^i  = 


i=l 


(5) 


The  optimal  decision  is  defined  as  a maximizing  decision  among  the 
alternatives,  and  its  grade  of  membership  can  be  expressed  as 

UjjQ  = maxUjj(x)  for  all  x in  X.  (6) 
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APPLICATIONS 


The  problem  we  are  dealing  with  here  is  one  of  project  selection.  One 
aspect  of  the  selection  decision  is  to  select  the  project  that  has  the 
best  probability  of  success.  The  constraints  under  consideration  are  the 
cost  growth  and  schedule  delay.  According  to  the  algorithms  [2],  the 
probability  of  success  of  project  is  a monotonic  increasing  function  of 
cost  and  time.  In  other  words,  the  more  money  and  time  given  to  the 
project,  the  more  likely  the  project  will  have  a higher  probability  of 
success.  The  decision  maker  then  is  to  find  a procedure  to  compare  and  to 
rank  order  the  projects  in  terms  of  the  probability  of  success  under  the 
imposed  constraints  of  cost  and  time. 

The  additional  cost  and  time  allowable  to  complete  the  project  is  usually 
not  well  defined  and  is  elastic,  reflecting  the  decision  maker's  preference 
and  the  need  at  the  time.  These  constraints  are  imposed  by  the  decision 
maker  and  are  not  statistical  in  nature,  and  there  is  no  randomness 
involved  (in  the  sense  of  probability).  They  are  qualitative  statements 
reflecting  the  degree  of  preference.  For  example,  the  decision  maker  may 
want  to  impose,  according  to  his  experience  and  with  respect  to  his 
understanding  of  the  nature  of  the  projects  and  his  organization,  that 
"I  can  tolerate  the  cost  growth  in  the  range  of  1 to  2 million  dollars," 
or  "I  do  not  want  to  see  the  cost  growth  to  be  too  much  beyond  1 million 
dollars,"  or  "The  schedule  delay  should  not  be  significantly  longer  than 
6 months."  These  types  of  propositions  can  be  properly  translated  into 
quantitative  measures  through  fuzzy  subsets. 

Let  us  now  look  at  one  fuzzy  proposition  "I  can  tolerate  the  cost  growth 
in  the  range  of  1 to  2 million  dollars."  In  order  to  quantify  the 
constraint,  we  may  want  to  ask  or  help  the  decision  maker  to  assign 
membership  function  to  this  fuzzy  constraint.  Assume  that  the  result  turns 
out  to  be  that  when  the  cost  growth  is  at  0.5  million  dollars,  the 
decision  maker  is  very  satisfied  and  assigns  a membership  function  of  0.9 
to  this  cost  growth.  He  then  continues  to  assign  a membership  function  of 
0.6  to  1 million,  0.4  to  1.5  million,  and  0.2  to  2 million,  indicating  that 
at  2 million  dollars  of  cost  growth,  he  is  not  satisfied  at  all.  This 
membership  function  is  sunnnarlzed  in  the  following  table: 

COST  GROWTH  IN  MILLION  DOLLARS 

Constraint  0.5  1.0  1.5  2.0 

Uc  0.9  0.6  0.4  0.2 

The  same  procedure  is  applied  in  assigning  membership  function  to 
schedule  delay  constraints. 
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According  to  Bellman  and  Zadeh  [4],  a fuzzy  decision  Is  the  confluence  of 

to  sfle^rSe  project  selection,  the  objective  Is 

to  select  the  project  that  has  the  highest  probability  of  success  iTnH,  r 

^hls  context,  the  optimal  decision  Is  defined  separately  for  each  coLt;ain, 


(7) 


(8) 


SL'trSntf  decisions  respectively  for  cost  and  schedule 


The  optimal  decision  D for  the  combined 
is  defined  as: 


consideration  of  both 


constraints 


D = max  {a  max  U„(c . ) 
j i C 


Py^^jl'^l^  +B  max  UgCSj) 
1 


Px(XjlSi)} 


(9) 


^ere  constraints  a and  B are  weights  assigned  to  th< 
reflecting  the  relative  importance  of  each  of  them. 


constraints 


In  general  terms,  for  n constraints  y. , 1=12 
is  expressed  as:  ^ ’ 


.n.  the  decision  policy 


893 


1 j are  tho  assl^iu-il  wol^hts. 


(10) 


These  ileclsion  policies  will  he  applied  to  an  example  In  the  following 
section  to  Illustrate  the  procedure  of  project  ranking. 


Kxaaj)  le : 

An  example  Is  taken  from  Reference  |31  to  Illustrate  the  appllcatU>n  of 
fuzzv  sets  to  rank  order  tlie  projects.  Assumi'  a set  of  five  projects 

“ { xj  ,X2  .X ) ,x^  ,x^  ( . The  cost  growth  and  schedule  delay,  obtained  from 
the  two  algorithms  [2],  are  presented  In  Figures  I and  2 respectively. 

The  decision  maker  Imposes  fuzzy  constraints  to  lie  "the  allowable  cost 
growth  should  be  in  the  range  from  8 to  ‘)  million  dollars,"  and  "the 
schedule  delay  acceptable  is  around  14  months."  Tables  1 and  11  summarize 
the  grades  ot  membership  associated  with  the  tuzzy  constraints. 

TABl.K  1 


l\)St  IJrowth 

1 tiraile  iif 

P 

Constraint 

Membersh ip 

In  10^ $ 

l\>lc) 

X 

8.0 

0.  7 

0 

8.S 

O.S 

0 

‘».0 

0.1 

0 

TABI.F. 

Schedule 

Criule  of 

Pro  ji 

De lay  in 

Memliersh  ip 

Months 

lls(s) 

n 

0.8 

0.  IS 

14 

O.S 

0.  IS 

IS 

0.  1 

0.  IS 

jecl  Probability  of  Success 


Pj 

X2 

<(x  1 c) 
’‘I 

>^4 

^5 

1 

0 

o.is 

0 

0 

11 

0.6  7 

0 .46 

O.ld 

0.1 

;ii 

0.7 

o.si 

0.S7 

0. 

1 1 


Probability  of  Success 
Px(x  ! s) 


X2 

^1 

X4 

’‘s 

0.74 

0.04 

O.n 

0.07 

0.74 

o.n 

0.16 

0.4S 

0.74 

0.22 

0.22 

0.64 

8 '>4 


Applying  the  decision  policy  presented  In  equations  (7)  and  (8),  the 
grades  of  membership  associated  with  each  project  and  tlie  selection 
decision  are  summarized  in  Tables  111  and  IV. 


TABLK  111 


Cost  Growth 

Grade  of 

Grade 

of  Merafu'rship 

of  Project 

Constraints 
in  10®$ 

Membership 
of  Constraint 

’^1 

Uc(ci)Px(x,  1 
X2  X3 

^•i) 

’‘A 

’‘5 

8.0 

0.7 

0.21 

0 

0.11 

0 

0 

8.5 

0.5 

0.16 

0 . 3A 

0.23 

0.10 

0.02 

9,0 

0.1 

0.0  3 

- 0-07 

0d)5__ 

_0.0b  _ 

0.06 

0.21 

(O.JA) 

0.23 

0.10 

0.06 

TABLK  IV 

Schedule  Grade  of  Grade  of  Meitbership  of  Project 

Delay  Membership  | ®1^ 

Constraint  of  Constraint  xj  Xt  x-i  xa  xc 
in  Months 

0.28  0.59  0.03  0.10  0.06 

0.18  0.37  0.07  0.08  0.23 

0.11 0.^2 0.02  -91 

Uq  0.28  (0.59)  0.07  0.10  0.19 

If  cost  growth  constraint  is  considered  alone,  project  x2  is  selected. 
Similarly,  if  schedule  delay  is  considered  alone,  again  project  X2  is 
selected . 

Now  combining  the  cost  and  schedule  and  assigning  weight  to  eaclt  constraint  , 
with  0.7  assigned  to  cost  and  0.3  to  schedule,  the  decision  policy  is 
summarized  below  in  Table  V, 

TABLE  V 

Grade  of  Membership  of  Decision 

xi  X2  X3  X4  X5 

Up  0,23  0.A2  0.18  0.10  0.11 


13 

0.8 

lA 

0.5 

15 

0.3 

C 

u 

f 

I 

t 
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In  this  case,  project  X2  Is  selected. 


I 


Suppose  project  X)  withdrew  trom  competition.  It  Is  then  easily  seen 
trom  Tables  111,  Tv  and  V that  project  X3  Is  selected.  If  cost  Is  the  only 
constraint,  .ind  project  xj  Is  selected.  If  schedule  Is  the  only  constraint. 
Wlien  both  constraints  are  considered,  project  xj  should  be  selected. 

It  Is  obseiveil  that  decision  Is  sensitive  to  the  ^rade  of  membership 
assigned  to  the  constraints.  ITils  reflects  the  subjectivity  of  the 
decision  nuiker  on  the  decision. 

CONCI.USION 

In  this  paper,  we  have  briefly  described  an  application  of  fuzzy  subsets 
in  ranking  of  projects,  wlilch  leads  to  decision  of  selection.  This 
r. inking  nuiy  be  considered  as  a measure  of  effectiveness  of  the  successful 
completion  of  laboratory  projects  within  the  cost  and  time  constraints. 

The  concept  .ind  approach  presented  liere  enable  the  decision  milker  to 
i|u;intltv  the  elastic  constriilnts  which  are  In  the  form  of  fuzzy  propositions. 

This  type  of  imjirecised  constriilnts  (fuzzy  but  not  random)  are  often 
encountered  In  reiillstlc  environment  under  which  alternatives  are  considered 
.ind  decisions  iire  niiide.  The  procedure  presented  In  this  paper  provides  a 
riitlon.il,  systeniiitlc,  and  consistent  method  to  liandle  such  kind  of 
constr.ilnts . It  is  not  difficult  to  see  that  when  the  constraints 
become  numerous,  the  situation  can  become  complicated  and  confusing.  This 
iipproiich  helps  lay  out  before  the  decision  nuiker  a portfolio  of  his  own 
utility  iind  |>erfi-rence  iind  perhaps  his  bias,  and  the  effect  of  each 
constraint  on  the  success  of  each  project.  With  this  portfolio  available, 
the  job  of  sensitivity  iinalysls  and  trade-off  study  can  be  more  easily 
hiindleil.  This  exercise  of  sensitivity  and  trade-off  study  Is  Important  in 
the  se.irch  of  vl.ible  .il ternat  1 ves  and  In  budget  allocation. 

The  theory  of  fuzzy  subsets  is  still  at  the  stage  of  development.  Research 
effort  Is  needed  ami  iippl Icatlons  are  still  to  be  drawn  from  such  concept. 
Kuzzy  subsets  relate  well  to  the  franx'work  of  human  information  processing 
.ind  natural  languiige  comprehension,  and  the  author  believes  that  they 
describe  more  iuleiiuatelv  than  the  probabilistic  approach  the  environment 
under  which  many  decisions  iire  nuide . 
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ABSTRACT:  In  the  analysis  of  ordinal  data  generated  in  testing  materiel 
systems  in  an  operational  environment,  the  statistician/analyst  is  often 
faced  with  the  task  of  producing  an  all  encompassing  inference  (assess- 
ing the  net  worth/effect)  about  a system  when  there  are  multiple  related 
measures  of  effectiveness  (MOE).  For  cases  where  the  MOE  or  character- 
istics are  weighted  and/or  when  the  results  are  unanimous,  the  analyst 
can  readily  draw  a conclusion.  However,  all  too  frequently  the  MOE  are 
not  weighted  nor  is  there  unanimity  among  the  findings  and/or  the  analyst 
is  interested  in  data  snooping  (a  posteri ori  unplanned  comparisons  aii'ied 
at  exploring  the  data).  In  these  cases  the  analyst  often  has  to  rely 
heavily  on  subjective  evaluations  or  analysis.  To  minimize  the  need  for 
these  subjective  evaluations  which  for  the  most  part  are  perfonned  in 
the  absence  of  viable  objective  evaluations,  the  US  Army  Infantry  Board 
conducted  a methodology  investigation  to  develop  procedures  and  accompany- 
ing computer  programs  to  facilitate  objective  analyses.  This  investiga- 
tion dealt  with  the  testing  of  means  (equivalence  or  nonequivalence  of 
multiple  MOE  means  among  systems)  using  analysis  of  variance  approach 
(multivariate  hypothesis  testing).  The  result  of  this  effort  is  a 
methodology  and  accompanying  computer  program  employing  Multivariate 
Analysis  of  Variance  tests  which  affords  the  user  a single  conclusion 
concerning  statistical  equality  among  the  means  of  compared  variables 
(MOE),  when  the  variables  (more  than  one  for  each  system)  are  correlated. 
Alternatively,  the  use  of  a series  of  analyses  for  each  variable  most 
likely  would  not  present  a clear  conclusion  since  the  single  analysis  does 
not  take  Into  account  the  correlations  among  variables  and  the  presence 
of  synergistic  effects.  The  program  developed  can  accommodate  the 
analysis  of  ten  variables  with  a maximum  of  30  observations  on  each  5 row 
and  4 column  treatments;  it  facilitates  data  snooping  since  it  calculates 
the  univariate  analysis  of  variance,  correlation  variables,  as  well  as 
the  multivariate  analysis  of  variance  results  for  either  one  basis  or  two 
bases  of  classification  tests.  The  limiting  conditions  for  the  application 
of  this  methodology  are  simultaneous  measurements  of  the  characteristics 
and  an  equal  number  of  observations  in  each  cell. 
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Test  and  evaluation  of  equipment  at  the  US  Army  Infantry  Board 
vJSAIB)  consists  of  a series  of  subtests.  Each  subtest  is  designed  to 
obtain  data  to  evaluate  the  test  item's  performance  against  one  or  more 
Issues  for  Test  and  Test  Criteria.  These  issues  and  criteria  are  de- 
veloped by  the  test  Item's  proponent  (combat  developer)  and  concern 
functions  of  the  military  system  in  an  operational  environment,  such  as 
firepower,  mobility,  survivability,  and  reliability.  The  issues  and 
criteria  are  derived  from  the  proponent's  Independent  Evaluation  Plan 
and  from  the  Coordinated  Test  Program. 

The  test  requirements  documents  normally  include  both  qualitative 
and  quantitative  criteria.  The  qualitative  issues  and  criteria  are 

addressed  based  on  typical  user  reactions  to  the  test  item,  man-equip-  '• 

ment  interface  problems  in  employing  the  item  in  a field  environment, 
and  military  utility  judgments  by  USAIB  test  supervisory  personnel.  The 
quantitative  issues  and  criteria  are  addressed  based  on  visual  or  elec- 
tronic counting  or  measuring  procedures.  ; 

I 

The  test  item's  performance  is  also  compared  to  the  standard  equip- 
ment that  the  test  item  is  designed  to  replace.  These  comparisons  are  I 

based  on  typical  user  employment  of  both  items  in  situations  representa-  ) 

tive  of  their  prospective  use.  On  occasion,  multiple  interrelated  test 
items  are  under  evaluation  and  are  each  being  compared  to  a control  (or 
standard)  item. 

» 

The  operational  mode  summary  (OMS)  and/or  mission  profiles  (MP) 
included  in  the  ROC  or  DP  describe  the  anticipated  mix  of  operational  modes 
and  their  expected  perceiitages  of  use  in  different  operational  and  environ- 
mental conditions.  The  OMS  and/or  MP  Impose  constraint  on  USAIB  testing. 

However,  their  inclusion  in  the  test  assures  realistic  control  of  the 
situational  variables. 

For  earh  subtest  I'or  both  test  and  control  items  under  specific 
expected  operating  conditions,  more  than  one  characteristic  can  be  measured 
simultaneously  with  current  USAIB  i i.strumentation  and  Automatic  Data  Pro- 
cessing Equipment  (ADPE).  Selected  measurements  of  the  test  item  can  be 
compared  to  the  testing  requirement  or  to  the  measurements  of  the  control 
item.  The  wording  of  the  requirement  dictates  the  type  comparison  to  be 
used.  Normally,  the  comparisons  made  concern  the  equality  of  several 
means,  whether  or  not  there  is  a significant  difference  among  the  means. 

In  the  analysis  of  ordinal  data  generated  in  testing  materiel  systems 
in  an  operational  environment,  the  statistician/analyst  is  often  faced  with 


the  task  ot  producing  an  all  encompassing  inference  (assessing  tne  net 
worth/effect)  about  a system  when  there  are  multiple  related  measures  of 
effectiveness  (MOt).  For  cases  where  the  MOE  or  characteristics  are 
weighted  and/or  when  the  results  are  unanimous,  the  analyst  can  readily 
draw  a conclusion.  However,  all  too  frequently  the  MOE  are  not  weighted 
nor  is  there  unanimity  among  the  findings  and/or  the  analyst  is  interested 
in  data  snooping  (a_j)_o^teri_o_rj  unplanned  comparisons  aimed  at  exploring 
the  data) . 

Previously,  the  testing  of  the  means  was  accomplished  by  the  analysis 
of  variance  approach  in  which  a simple  analysis  is  made  for  each  character- 
istic (variable).  The  result  of  the  individual  analyses  are  then  com- 
bined in  order  to  arrive  at  an  overall  conclusion  with  respect  to  all  the 
characteristics  taken  together.  This  approach  is  subjective  and  fails  to 
consider  either  the  presence  of  synergetic  effects  or  the  relationship 
among  the  variables.  To  minimize  the  need  for  these  subjective  evalua- 
tions, Major  William  J.  Owen  and  Mr.  Jimmie  C.  Deloach,  formerly  of  the  US 
Amy  Infantry  Board,  conducted  a methodology  investigation  to  develop  pro- 
cedures end  accop'panying  computer  programs  to  facilitate  objective  analyses. 
Although  tnere  are  several  MVA  techniques  available  to  the  analyst,  tnis 
investigation  is  limited  to  multivariate  analysis  of  variance  (MANOVA)  and 
deals  with  the  testing  of  means  (equivalence  or  nonequivalence  of  multiple 
MOE  means  among  systems)  using  the  analysis  of  variance  approach  (multi- 
variate hypothesis  testing). 

Although  the  MANOVA  application  of  MVA  is  recognized  as  being  viable 
and  offers  much  potential,  the  application  is  not  widespread.  Some  reasons 
which  account  for  the  limited  application  are:  it  is  a supplementary  tool 
of  analysis  of  variance  (it  is  not  the  panacea);  the  de'-cription  and  pro- 
cedures are  for  the  most  part  fragmented  among  various  references;  and, 
the  procedures  are  considerably  more  complex  than  the  common  univariate 
analysis  of  variance  tests. 

The  result  of  this  effort  is  a methodology  and  accompanying  computer 
program  employing  Multivariate  Analysis  of  Variance  tests  which  affords  the 
user  a single  conclusion  concerning  statistical  equality  among  the  means  o'' 
compared  variables  (MOE),  when  the  variables  (more  than  one  for  each  system) 
are  correlated.  Alternatively,  the  use  of  a series  of  analyses  for  each 
variable  most  likely  would  not  present  a clear  conclusion  since  the  single 
analysis  does  not  take  into  account  the  correlations  among  variables  and 
the  presence  of  synergistic  effects.  The  program  developed  can  accommo- 
date the  analysis  of  ten  variables  with  a maximum  of  JO  observations  on  each 
5 row  and  4 column  treatments;  it  facilitates  data  snooping  since  it  calcu- 
lates the  univariate  analysis  of  variance,  correlation  variables,  as  well  as 
the  multivariate  analysis  of  variance  results  for  either  one  basis  or 
two  bases  of  classification  tests.  The  limiting  conditions  for  the  appli- 
cation of  this  methodology  are  simultaneous  measurements  of  the  character- 
istics and  an  equal  number  of  observations  in  each  cell. 

The  required  design  characteristics  for  the  fWlOVA  to  be  developed 
were  that  the  procedures  be  logical,  simple,  and  adaptable  to  AOPE. 
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Accordingly,  the  nomal  procedures  ascribed  tor  MVA  were  followed. 
Concurrently,  with  this  process  all  methods  were  verified  through  the 
use  of  example  problems  fr\im  various  references. 

to  exemplify  the  program's  application,  data  from  the  Accuracy  and 
Zero  Correlation  subtest  of  the  Development  Test  II  (Service  Phase)/ 
Operational  Test  II  of  the  Rimfire  Adapter  (RFA)  for  the  V16A1  rifle  were 
analyzed.  Specifically,  the  four  measures  of  dispersion  were  evaluated 
concurrently  by  treatment  and  range  using  a two-way  MANOVA.  The  results 
of  the  application  of  this  program  agree  with  the  RFA  test  report.  The 
MANOVA  utilized  the  correlation  between  variables  whereas  in  the  uni- 
variate analysis  this  intoniiation  was  disregarded.  In  the  univariate 
analysis,  four  comparisons  (one  for  each  measure  of  dispersion)  among 
the  three  RFA's  had  to  be  analyzed  for  each  range  while  in  the  multi- 
variate analysis,  conclusions  are  provided  from  a single  set  of  compari- 
sons at  each  range.  Accordingly,  when  correlation  exists  among  variables, 
the  ^VA  is  superior  to  the  univariate  analsis. 

During  the  test  of  the  RFA,  the  following  measures  were  employed; 

a.  Mean  Offset  (?).  The  mean  distance  from  the  point  of  aim  to  the 
Shot  group  centers  of  impact. 

b.  Mean  Radius  The  mean  distance  from  the  center  of  impact  of 

the  Shot  groups  to  each  of  the  impact  points. 

c.  Average  Extreme  Spread  (CS).  The  mean  ot  the  distance  between 
the  two  most  extreme  impact  points  for  each  of  the  shot  groups. 

d.  Mean  Drop  (Dl.  The  mean  of  the  vertical  components  of  the  offsets. 

The  data  for  these  four  measures  were  collected  in  accordance  with 
the  approved  test  plan.  Three  groups  of  soldiers  used  one  of  the  three 
RFA  devices  to  engage  a 'Modified  Canadian  Bull  Target  at  25,  d2,  ''5,  120, 
and  125  meters  from  the  prone  supported  firin,)  position.  Each  of  the 
soldiers  fired  three  5-round  shot  groups  at  each  of  the  targets.  Based  on 
the  X,  V coordinates  of  each  round  of  each  shot  group  for  each  soldier  for 
each  RFA  device,  the  means  and  standard  deviations  o^'  each  of  the  four 
characteristics  were  computed. 

Univariate  two-way  analyses  of  variance  were  performed  on  each  of 
the  characteri sti cs  using  range  and  device  as  factors.  In  this  test  there 
were  three  treatments  (,i.e.,  devices  RFA-A,  RFA-B,  and  RFA-C'  and  ^'our 
measures  of  dispersion  (\  R.  ES , anj  D'  for  ■five  ranges.  For  each  range, 
each  measure,  and  each  treatment  there  are  ton  replications  li.e.,  12 
soldiers ) . 

A two-way  MANOVA  was  executed  using  range  and  device  factors  and  the 
four  measures  as  variables.  The  results  of  this  M',''0VA  are  shown  in  this 
table  (Table  11. 
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Because  of  the  siynificant  interdclion  between  device  and  range, 
comparisons  based  on  the  outcome  of  the  two-way  MAfJOVA  were  not  made 
between  the  individual  devices  and  ranges. 

Five  one-way  MANOVA's  and  four  follow-up  hotelling's  tests  were 
executed  (i.e.,  one  for  -ach  range).  Tne  results  of  these  MANOVA's  are 
shown  in  Table  2 and  3.  A summary  of  conclusions  based  on  these  results 
appears  in  Table  4. 

The  results  in  Table  4 indicate  that  RFA-A  and  RFA-B  are  not  signi- 
ficantly different  except  at  a range  of  4.’  meters.  Also,  RFA-A  and 
RFA-C  are  significantly  different  at  every  range  considered  except  25 
meters.  Finally  RFA-B  and  RFA-C  differ  significantly  at  every  range 
except  25  meters. 

A comparison  of  the  multivariate  results  in  Table  A-llI-30  of  the 
RFA  test  report  appears  in  Table  5.  A summary  of  some  of  the  iixire 
important  points  of  this  comparison  follows; 

a.  Overall,  the  MVA  conclusions  confirm  the  univariate  findings 
with  the  exception  of  the  42-meter  range.  The  univariate  findings  show 
adapter  6 eguivalent  to  adapter  C for  each  variable,  while  the  MVA 
findings  show  adapters  P and  C to  be  nonegui val ent  at  a range  of  42 
meters  when  all  variables  are  taken  together.  The  difference  in  two 
findings  is  a direct  result  of  the  univariate  analysis'  failure  to  take 
into  account  the  correlation  among  the  variables. 

b.  Note  that  for  each  range,  there  are  12  univariate  test  conclusions 
as  opposed  to  three  multivariate  conclusions.  The  univariate  method  does 
not  permit  the  formulation  of  a joint  conclusion  with  regards  to  the  equiva- 
lence (or  nonegui valence)  of  the  three  adapters  for  a particular  range  as 
does  the  MVA  method.  Further,  a given  set  of  univariate  conclusions,  one 
for  each  variable  under  consideration,  will  not  always  agree  with  the  MVA 
conclusions  when  the  variables  are  being  considered  simultaneously. 

c.  For  the  reasons  indicated  above  the  MVA  approach  is  superior  to 
a series  of  univariate  analyses  when  the  variables  are  correlated. 

The  example  illustrates  that  the  methodology  and  programs  developed 
are  applicable  in  determining  correlation  between  variables;  performing 
univariate  analyses  when  no  correlation  exists;  and  conducting  multivariate 
analyses  when  correlation  is  present. 

The  following  two  figures  (1  and  2)  depict  the  flow  chart  of  the  com- 
puter program  used  to  conduct  the  analyses  of  the  example  just  illustrated. 

The  procedures  outlined  above  have  been  programmed  in  FORTRAN  IV. 

The  response  data  is  the  input  and  the  program  uses  four  subroutines. 
"HOTEST"  tests  the  dispersion  matrix  for  homogeneity  and  compound  symmetry. 
"FTEST  I"  and  "FTEST  2"  perform  the  MANOVA's  and  compute  the  F-values. 


"HOTtL"  performs  the  Hotelling’s  on  each  combination  of  two  treatments. 

All  four  subrviulines  are  u'^ed  tor  each  set  of  input  data  when  the 
data  can  be  classified  in  two  ways.  However,  when  the  data  can  be  classi- 
fied in  only  one  way.  FTEST  2 is  not  executed.  Also,  when  a value  obtained 
from  FTEST  1 is  not  significant,  the  results  from  HOTEL  may  be  ignored. 

A user  package  has  been  developed  which  explains  the  control  cards 
and  the  correct  procedure  for  the  input  data.  It  also  includes  a program 
listing  (PROGRAM  MULTVAR)  which  is  currently  on  the  CDC  6400  at  Fort 
Leavenworth,  Kansas.  The  original  program  was  designed  for  the  IBM  360 
computer  using  FORTRAN  IV.  That  program  can  be  obtained  through  DDC  by 
reguesting  the  report  whereas  a copy  of  the  MULTVAR  Program  can  be  obtained 
by  contacting  the  Management  Division  of  the  USAIB  and  requesting  it. 
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HOTELLING'S  TEST  RESULTS  BY  RANGE 
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Figure  1.  Flow-Chart  of  MANOVA 
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Cq  = Fixed  cost  of  testing 

N “ Number  of  observations 

Cj^  “ Cost  of  sampling  for  observation  i 

C * Penalty  cost  of  a type  I error 
u 

C = Penaity  cost  of  a type  li  error 
6 

a = Probability  of  a type  I error 
B “ Probability  of  a type  II  error 

The  procedure  considers  the  EASC  necessary  to  make  a decision  regarding  main  . 
effects  only.  That  is,  the  decision  was  of  the  type  needed  to  determine  the 
advisability  of  adopting  a proposed  device  over  a standard  device  or  equipment. 
Consequently  the  factor  "system  type"  in  the  experiment  appears  at  only  two 
levels  and  the  hypothesis  of  interest  are 


"l  - 


0 


»1=  ^1  ■ ^2  " ^ ° 

The  null  hypothesis  states  that  the  proposed  device  is  not  significantly 
better  than  the  standard  for  comparison  (SFC) . The  alternative  hypothesis 
states  that  the  proposed  device  is  better  than  the  SFC  by  an  amount  d,  the 
performance  margin  required  for  adoption  of  the  proposed  device.  The  required 
performance  margin,  d,  must  of  tooine  be  specified  in  order  to  compute  the 
probability  of  making  a type  II  error,  that  is,  the  probability  of  failing  to 
reject  the  null  hypothesis  when  the  proposed  device  is  better. 


Figure  1 illustrates  the  errors  and  penalty  costs  in  operational  tests 
required  for  evaluation  of  the  last  two  terms  in  the  cost  model.  The  other 
model  components  would  usually  be  well  known  for  any  specific  test  situation. 


For  a general  factorial  experiment  involving  K factors  the  cost  model 
(1)  becomes 

L, 


'1 

EASC-C^-.!  ...  I A C 

e =1  ^ K 1 

1 K 


V Cg6(a,A,Vj.,v^) 


(3) 


where 


L.  = number  of  levels  of  the  i^^  factor,  X., 
i 1 

level  of  the  1^^  factor. 
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The  aouooot ra I i ty  paramo lor  A is  ronuirod  to  compuLo  lUo  typo  11  orror 
prohahilitv  P.  It  is  a tuiicllon  ot  t iio  do>;roo  to  whioh  llo  is  tal  so,  ihi' 
iwimbov  ot  laolors  oonsidorod  in  tho  dosip.ii,  and  tlio  saniplo  sizo.  Kuss  [4] 
>;ivos  oomputiiiK  tormulas  lv)r  V tor  nnbalancod  taotorial  dosij;ns  involviii(; 
a -siiiitlo  oovariato. 


f’i>ti.iro  1.  Krrors  and  I’l'iniUv  Costs  in  vfporatvonal  Toslii\>; 


i’aramotor__f^st  iro.itos  Noodod.  Tho  tollowin);  parauiotor  ostimatos  aro 
noodod  prior  to  tho  dosisn  ot  OT- 1 , tho  first  stai;o  oporational  Lost. 

1.  All  cost  cootfioionts 

2.  Krror  varianoo  tor  tho  rosponso  variable  iu  a oomplotoly  random 
dos ign 

J.  Correlation  ooollioionts  botwoon  tho  rosponso  vart.tblo  and  oaoh 
oovariato  as  woll  as  all  control  factors 

4.  Tho  ratio  ot  tho  avor.igo  variation  ot  oacli  lactoi  .ibout  its 
fixed  level  to  its  population  variance. 


The  values  of  these  parameters  would  usually  come  from  developmental  tests 
conducted  on  the  devices  or  from  similar  operational  tests  conducted  previously. 

They  may  also  be  obtained  from  a series  of  pre-tests.  Other  sources  of  data 
Include  combat  and  field  training  exercise  after  action  reports,  TRADOC 
studies,  intelligence  studies  and  simulation  experiments.  The  estimates  for 
subsequent  test  phases  (OT-Il),  etc.)  would  be  obtained  from  the  first  phase  (OT-1). 

to  Ejtample:  To  Illustrate  the  specific  form  of  the 

cost  model,  a 2^  factorial  design  with  all  factors  (X|,X2, . . ..Xj.)  fixed  and  a 
single  covariate  (Z)  will  be  presented  in  detail.  The  factor  "system  type"  is 
denoted  by  Xj^.  Assuming  that  the  liypotheses  (2)  are  of  interest,  the  problem 
becomes  one  of  choosing  the  number  of  observations  nij(i»l,2,  j”!, 2, . . . 2^“^) 
and  a to  minimize  ^ , 

2 2^“^ 

EASC  = C-  + I I C.n.,  + C a + C e(a,X,v  .V  ) (4a) 

0 ioj  j-i  i ^ t e 

subject  to 

I n <S  (i=l,2)  (4b) 

j = l 


where 


"ij  - ^ \/i,J 

0 < a < 1 

n . . integer 
tj 


(4c) 

(4d) 

(4e) 
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and 


,K-1 


'■i  * 


,K-1 


'Sv) 


e e 


(51) 


In  (4b),  Sj  and  S,,  ri-presi’nt  tlio  constraints  imposed  on  tlie  maximum  number 
of  observations  tliat  may  be  taken  wiMi  tlie  new  system  (i“l)  and  t)ie  SKC  (i“J). 
respectively.  (4c)  is  Imposed  to  insure  tiiat  all  cells  in  t tie  desi>;n  liavi’  at 
least  two  replicates,  permitting;  an  estimate  of  experimental  error  tor  each  cell, 
and  also  avoiding  the  ditiiculties  in  interpretation  sometimes  caused  by  unbalanced 
factorials  with  some  empty  cells.  Also,  note  th.it  (5a)  re-sults  l rom  the  factor 
"system  type"  appearing  at  two  levels,  and  (5b)  is  the  error  degrees  ol  fri’edum 
with  unequal  sample  sizes  adjusted  for  .i  single  covariate.  (5c)  expresses  the 
design  error  variance  in  terms  of  the  variance  of  the  response  variable  o^!,  the 
correlation  coefficient  between  the  factor  Xj  .ind  the  response  ej;.y,  the 
average  variance  oi,  X.  around  its  fixed  levels  . and  the  population  varianee 
of  X^  denoted  by  Jy  . • This  relationship  is  based  on  Keldt  [1].  (5d)  and  (5e) 

define  the  noncent  ra*I  i t y parani'ter  for  an  unbalanced  2*^  factorial  design.  Finally, 
(5f)  is  based  on  a central  K approximation  to  the  noncentral  F distribution. 

Modi'l  Opt imi zat ion.  An  optimization  algorithm  based  on  the  partial 
enumeration  method  of  Neuhart  and  Bradley  [3]  was  used  to  solve  (4).  I'he  algorithm 
uses  a sequential  analysis  of  the  functional  relationships  between  t lie  const, mis, 
par.imeters,  and  variables  of  the  model  to  eliminate  infe.isible  .md  nonopt  inxil 
alternatives.  A complete  description  of  the  algorithm  ;md  a FORrR(\N'  IV  program 
listing  is  given  in  [41. 

Analysis  of  the  ObJ^cctiv^'  Functiojn.  We  shall  now  briefly  discuss  the 
beh.avlor  of  the  objective  function  and  the  rel.il  ionships  between  the  decision 
variables  iij,  n^  (the  optimal  allocation  of  observations  to  system  types  1 and 
2,  respectively)  v and  a.  Figure  2 shows  several  cost  factors  and  rates  of 
change  of  cost  factors  plotted  as  functions  of  (Tj . To|a,N),  the  individual 
tre.atment  sample  sizes  when  the  total  sample  size  and~a  .ire  fixed.  Since 
is  bounded  (due  to  s.ample  size  restrictions),  only  a portion  of  figure  2 
will  actually  occur.  Also,  since  T^  takes  only  integer  values,  only  discrete 
points  within  th.it  segment  can  occur.  Figure  3 illustrates  these  segments  of  tho 
EASC  curve  which  are  obtained  from  tho  simulated  data  for  sevor.il  different 
values  of  N,  the  total  sample  size.  It  should  be  noted  that  increasing  the 
value  of  N shifts  the  segment  of  the  FASC  curve  from  right  to  left  with 
respect  to  Figure  2. 

Figure  4 illustrates  the  effect  of  increasing  the  significance  level,  a. 

The  figure  shows  that  as  a increases  all  of  the  curves  in  Figure  2 are  compressed 
to  the  left.  This  is  because  as  a increases,  for  fixed  .S,  the  rate  ot  change 
of  P with  respect  to  T^  increases. 
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Selecting  for  each  value  of  N the  optimal  allocation  of  observations, 

(n,,  n2).  results  in  the  tbVSC  values  shown  in  Figure  5.  Note  tliat  as  the  signif 
icance  level  Increases,  the  optimal  number  of  observations  Initially  increases, 
then  decreases.  This  is  the  result  of  the  variations  in  the  rate  of  change  of 
6 with  respect  to  N for  given  values  of  a and  N.  Where  this  rate  is  high  enough 
to  off-set  the  Increase  in  sampling  cost,  increasing  N will  reduce  EASC.  Once 
this  rate  decreases  to  the  point  where 

{^\  ^ ^ 

6 \aN / AN 

then  incre.asing  N will  increase  EASC. 


Figure  2.  EASC  as  a Function  of  (T  ,T  la,N)  - General  Form 
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SL'MMAKY  OK  TKS'l'  Dl'.SU'.N  I’ROCKUUKh 


Thf  b.itiic  pnici'Uuro  tor  llio  Josiy.n  ul  an  01'  Jovo loi>f(J  by  this  study  is 
sununarized  by  tbo  tollowin>;  lA  sti‘|>s. 

1.  Uetormino  minliimm  miiiiluT  and  t vpo  of  1 actors  to  bo  consldori'd  and  how 
thoy  aro  to  bo  combinod  to  dotorinino  tlu’  coiulitiims  undor  which  obsorvat  ions 
will  bo  takou.  'I'ho  minimum  numbor  ot  lactors  will  >;onorally  bo  dictatod  by 
tho  tost  Issues. 

2.  liotonnini  rosjjonso  v.iri.iblo  to  bo  luo.isuri-d  (MOl.) . Tliis  must  bo  a continuous 
varlablo. 

3.  Korraulato  tho  appropriate  response  model  b.isod  on  stoj>s  i and  2. 

A.  Select  tho  sot  of  i-xact  hypotheses  to  bo  used  as  tho  basis  for  optimization. 
.Normally,  this  would  bo  tho  null  hypothesis  ol  no  tri-atmont  offi'ct  versus  an 
exact  form  of  tho  alternate  hypothesis:  the  tisti’d  system  exceeds  the  .SKC  by 
Che  required  performance  m-iryin. 

5.  Determine  the  cost  model  to  include  estimates  ol  all  cost  coefficients 
and  primary  parameters. 

6.  Kormulate  the  optimization  problem  to  include  all  constraints. 

7.  Apply  the  KASC  alttorithm  to  detennine  the  number  of  observations  to 
be  taken  in  e.ich  row  and  their  distribution,  tlie  level  of  s i gni  f ic.ince , .ind 
the  power  of  the  tost. 

8.  Use  a random  process  to  .issiqn  observ.it  i ons  to  sitecific  cells  and  to 
determine  the  sequence  in  which  observations  are  to  be  taken. 

9.  Vary  the  control  limits  on  the  levels  ol  factors  to  determine  the  optimum 
control  required  if  control  is  .anticipated  to  become  a problem. 

10.  Repeat  steps  5,6,  and  7 for  .any  alternitives  which  may  be  of  interest  to 
the  experimenter  such  as  addition  of  a blocking;  factor  or  covariate,  an  incriMse  in 
the  number  of  observations,  if  the  previous  optim.il  solution  occurred  at  tiie  upper 
limit  of  this  constraint  for  one  or  both  t re.itments,  or  fmctienal  replication. 

11.  Select  the  optimal  fciisible  alternative. 

12.  Begin  experimentation. 

13.  Correct  estimates  oi  input  parameters  as  test  data  becomes  available. 

lA.  Repeat  Step  7 and  other  steps  as  necessarv  to  determine  the  effect,  it  any, 
of  the  corrected  parameter  estim.ites  on  the  optim.il  solution. 

AN  K.XAMl’l.K 

The  algorithm  was  demonstrated  by  a hypothetical  example  in  wliich  operational 
tests  were  to  be  designed  to  evaluate  the  overall  military  worth  of  a new  ground-to- 
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air  tactical  missile  system,  uVfVMS,  which  is  under  development  as  a replacement  for 
the  llAWK  missile  system.  The  specific  illustration  concerns  tests  for  the  guidance 
sys-tem. 

The  critical  issue  for  evaluation  is  the  accuracy  of  the  guidance  system. 
Ambient  temperature,  altitude  of  target,  and  speed  of  the  target  are  the  most 
likely  factors  to  have  a significant  effect  on  tlie  accuracy.  The  maximum  numbers 
of  TAAMS  and  HAWK  missiles  that  may  be  fired  in  each  phase  of  the  OT  to  evaluate 
the  guidance  system  are  12  and  20  respect i vely . The  measure  of  effectiveness 
(MOE)  is  stated  as  the  mean  miss  distance  from  the  target. 

3 

A 2 completely  randomized  factorial  design  was  selected  wltfi  ambient  temper- 
ature, Z,  treated  as  the  covariate.  The  two  independent  variables  were  altitude 
of  the  target,  X2,  and  speed  of  the  target,  Xj.  These  two  variables  are  treated 
as  control  variables  while  ambient  temperature  was  considered  a covariate  since  it 
could  not  be  controlled.  Factor  X^  is  the  missile  type. 

The  test  designer  then  uses  the  proposed  procedure  to  determine  the  number 
of  firings  to  be  used  for  each  missile  type  and  their  distribution  among  the  2^ 
cells  of  the  des_gn.  Estimates  of  cost  coefficients  and  variability  estimates 
required  for  use  of  the  procedure  are  first  obtained.  These  are  shown  in 
Table  1. 

Figure  6 shows  the  results  of  the  use  of  the  EASC  program  with  the  input 
values  listed  in  Table  1.  The  optimal  values  shown  in  Figure  7 were  found  to  be, 
a = 0.29,  N = 16,  T^  = 8,  T2  = 8 and  B = 0.2207.  This  resulted  in  an  EASC  of 
$8,907  M. 


Table  1.  Initial  Input  Data  for  OT-  I 


Cost  Coefficients 

(million  dollars)  Primary  Parameters 


1.000 

0^  = 4.000 

-2 

Or,  * 

2.000 

10.000 

10.000 

Y 

d = .200 

"x  Y = -500 

"2 

-2 

2.000 

.250 

2^ 

2 

0 *= 

20.000 

X2 

.100 

2 

2 

0.,  = 

10.000 

P^Y  = -500 

^3 

During  a planning  meeting  a new  control  unit  costing  $7,000  was  proposed  for 
the  target  drones.  This  control  unit  would  reduce  altitude  variations  by  50%. 

The  new  value  of  the  control  variance  for  altitude,  , was  then  inputed  to  the 
EASC  program.  All  other  parameters  were  left  the  2 same.  This  gave  a new 
optimal  solution  of  $8,987  M,  a reduction  of  $10,000.  This  was  used  to  justify 
the  purchase  of  the  new  control  unit  and  the  first  test  phase  was  conducted. 
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FlKure  b.  Optlmaa.  (KASC/u  lor  Initial  OT  1 liosign 

The  results  of  tiie  first  phase  are  used  to  revise  the  parameter  estimates  for 
subsequent  phases.  The  input  data  for  OT  11  are  shown  in  Table  2 and  Figure  7 
illustrates  the  results  of  this  run  of  the  KASC  program.  It  is  to  be  noted  that 
the  error  costs,  and  C^, , are  changed  for  the  OT  II  tests.  Following  the 
evaluation  shown  in  Figure  7,  the  performance  m.irgin,  d,  was  reduced  from  0.200 
to  0.150.  This  necessitated  a new  program  run  and  resulted  in  a new  set  of 
values.  The  new  values  were: 

u = 0.21 
b - 0.258'J 
n = 18 


T.,  = 10 

F5\SC  = $12,074  M 

For  OT  III,  new  estimates  of  the  input  data  were  determined.  These  included 
significant  Increases  in  and  since  an  error  would  now  become  critical. 
Results  of  OT  III  will  be  used  to  decide  whether  to  put  the  T/Vr\MS  missile  into 
production.  The  new  data  shown  In  Table  3 and  the  output  is  graphed  in  Figure  8. 
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TabU' 


Initial  Input  Data  tor  UT  II 


Cost  Coi'l  f Ic  lout  s 
1 1 Ion  jiol  lars) 


I’rliiiary  I’aramotors 


‘■'0 

1 . 000 

■) 

"y 

2.  500 

-2 

.800 

c 

u 

- 

20.000 

d 

=> 

. 200 

1 . 400 

2 

c 

b 

m 

15.000 

. 700 

2 

0 “ 

20.000 

^'l 

- 

. 250 

4,v 

- 

.bOO 

^2 

■> 

“ 

10.000 

1^2 

- 

. 100 

*‘ZY 

m 

.650 

.S/i./vo'/C*  v(  I i / I ^ i f a ) 


Kltiuri'  7.  Optimal  (.i.ASC/a)  lor  Initial  01'  11  Data 


Table  1.  Initial  Input  Data  tor  l)l'  111 


Cost  Coefficients 

Qmi  1 1 ion  viol  lars) 

1‘rim.iry  I’ar 

.line  t e rs 

Cy  - 1.000 

- 2. 500 

_ '} 

» . 800 

C - 500.000 
u 

d =>  .150 

_ •> 

- 1.400 

•> 

C , - 150. 000 

*’x,Y  = .600 

■) 

^x. 

= 20.000 

e^  - .350 

“ . bOO 

3 

•> 

= 10.000 

c - .100 

p‘y  = -550 

.(7 


^ ' < 4 ! < g ,f  7 

SiuNlf  I.  A/Vi  / Ift/i  ) 


K i>;ui  e S. 


Optimal  (1;aSi'/<j^  tor  Initial  t)l'  111  Data 


I’rtor  to  testin>j,  .«  new  speed  control  ili-viee  is 
tarp.et  drones  wbieli  reduces  the  variance  in  speid,  o 
value  Is  tlu'n  used  for  the  program  and  a new  viptiiivtl 
This  Is: 


introduced  on 
. In  .'8.  S'... 
^ solvit  ion 


t he 

This  new 
is  obtaini'd 


vl 

0.01 

0. 1127 

N 

= 

12 

■''i 

X 

12 

■>'2 

m 

20 

KASC 

X 

$111.  10  7 

This  ri'hiii-oJ  t ho  oxpooloci  i ost  In'  $Sfi2,00t).  Tho  cost  ol  tlu-  iJ  now  ilrniu-s  is 
$120,001'  .iiiJ  tiioroloro  tlio  now  Ji'onos  won'  jnstiiioj. 

i'lio  rosuits  nhovo  iiullciito  usinp,  llu-  nuxiniun  luimbor  ol  liiings  lor  tun  li 
missiio  systi'ms.  llocauso  of  tliis  rosnit  t lio  proj; raw  was  run  aj’,jin  lo  ili' 1 1' riiii  ni' 
tlio  ottoot  on  tiASC,  of  incri-asinj^  tlu’  altowahii'  numtu'r  ol  ILMv’K  missiios  to 
21.  I'lio  ri'sults  wori'  ohsorvoU  to  l>o: 


I 


i - 0.0‘) 

h =■  0.1  $02 

N = IT 


1;A.SC  = $11''..  8 11  M 

Tilts  roJuoti'jn  ol  $276,000  in  T.A.SO  could  lio  obtaiiu'd  in  an  oxponJ  i tui  i'  ol 
$100,000  tor  tho  addilonal  missiio  and  t !ius  tlio  addit  ional  IIAK’K  could  lu-  justiliod. 

Ot'NOl.TSlON 


rtiis  paiu-r  has  dovolopod  a crilorion  ol  oX|)Oi  tid  addit  ion.il  systoni  co  .t  as 
a iiio.isuro  oi  tlio  rclativi'  olticionov  ol  a 1 1 1'rn.it  i vo  oxpor  imoiit  a 1 dosip.n  pioci'dun's 
tor  operational  tests  conducted  with  s.tiiipli'  si.-.o  constraints.  A hy  pot  lie  t i ca  1 
I'xamplo  Wits  used  to  donionst  r.ilo  tlio  mo  t hodo  1 op.y . The  decision  altornativos  th.it 
n.iv  bo  evaluated  usiii}’,  tliis  mothodo  lopv  can  bo  I'xtondoii  beyond  those  shown  in 
tho  oxanipli'.  Hy  v.irviny,  par.iniot ors , m.inv  other  sitiialiinis.  such  a.s  tho  addition 
or  deletion  ol  a covariato  and  I’st  iiiiati's  of  tho  oftocts  ol  p.iranutor  mi  sspoc  i I i c.it  ii>n. 
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ilTlt:  Gdtllofiold  Visualization  Craphics  /'nalysis  rfct.iiiqucs 

AUri;0K(S);  Dr.  L.G.  Pfortmi  1 Icr,  Mr.  R.A,  Davison 

ORn'M/AllON:  UiACACDA.  Ft.  I.eavenv.orth , KS  CG027 
A'MOVCN  bb2-b?58/'jK»0 

A'.'.STRACr;  rt.o  potcnLial  use  of  intoractive  c<-.putor  display  vjr.’pln'os 
i.pplied  to  terrain  analysis,  tactical  riai.ruvcr  planniii'j,  tost  ai\ilysis, 
..i.d  rodol  sot  up  and  analysis  is  doscrihod  in  this  p^por.  Fpocific 
c'aiplf.s  of  contour,  veectation,  cultural,  iccd/rail  i.'ts,  biidce 
:nd  obstacles,  cpoiv.ticns  overlays,  fields- )f-firo,  etc.  pror'.'cod  in 
plc.r.es  r.ap  overlay  ferrat  aro  discussed.  Prcjoction  of  sir.ilar  ovorK-ys 
fro::i  ijrcund  and  aerial  3-D  porspoctivos  aro  also  i 1 1 us tra tod . Ii.tor- 
arti\e  i.an  racliiiio  interfaces  and  appl  icrticr.s  ai'O  addressed  in  C' nti’st 
of  study  appl icot ions  exercises. 

ISIIMATliD  lIME  F.PQUIRtD  1 OR  FRCSI.M l7\l  1 OR : 3C-A0  i..ii,iitos. 

CMrOCRY  AOrdOFr  lAi  t I cR  THIS  I'AFfR;  Special  s.'ssien  lo;ic:  Raw 
OR/SA  Teclinie.uos . 


Sul'j.'Ct:  Tattlencld  Visual  i;ation  Graphics  Analysis  Techniques 

’ulhors;  Dr.  L.  G.  rrcrlniller,  Mr.  R.  A.  Davison 

'aoncy:  Cc-''i''ed  Aivs  Coi'hat  ncve1cp"ients  Activity,  Cor'bat  Operations 
Analysis  Di i\'C tora te , fort  Leavenworth,  Kansas 

A.  lA.-.oDUCIION. 


1.  Tl'.c  I ..rid  ijrcwth  of  teci.r.olcqy  in  ADD  and  interactive  computer 
ijrujhics  r.  pi  r-M-i.ts  a vast  potential  for  devd opi’Ont  of  OR/SA  techniques 
applied  to  c,  Vit  lodol  singulations  ai-.d  gardes.  At  tlie  Combined  Anns 
Centor  at  Fort  I ravei'-.oi  th , ^.-insas  we  are  tabing  some  initial  steps  to 
C'.plore  this  env i ror.  "ont , During  this  presentation  I will  illustrate 
potential  uses  of  interactive  cc  pater  display  graphics  applied  to 
terrain  analysis,  scenario  dcvelop'ont , tactical  r aneuver  planning,  test 
oralysnc , and  co  bat  model  set-up  at  d pest  aitalysis. 

?.  To  do  so  I (nave  c(ioson  tlirco  recent  studies  eiKicr  in  process 
or  riH'cntly  to  pleteo  at  CACDA.  TIu'se  are  the  Division  Restructure 
Study,  The  Family  of  Scattorable  Mines  (FASf-W)  COEA  Study,  and  the 
Analysis  of  the  Antitank  Missile  Test  (ATMT)  conducted  at  Fort  Hunter 
Liggett,  California  by  COEC.  The  initial  cvai.ple  is  tlie  Division 
Fostrt.'ciuro  Study.  The  application  is  the  use  of  co  .puter  grapliics  in 
ti.e  iactical  planning  and  scenario  dcvclcpr.,ont  pl'.ase  of  setting  up  the 
Cfa'd'oRi. 1 1 E rodol  to  be  used  in  the  analysis  effort. 

8.  lERRAIN  Ar.'ALYSIS. 

1.  The  tci-|-ain  gi'id  sliown  (slide  2)  is  a 10  km  x 8 km  piece  of 
terrain  no>'th  and  j'  st  west  of  EUl  DA.  The  display  slides  v.'ore  taken 
i-.ith  a uSmn  car.ora  diiectly  off  of  tlie  tektronix  4014  CRT  display 
scroefis.  (Ektaclii'cirio-X  ASA64  film  with  1 second  exposure  was  used.) 

The  iorrain  grid  lines  are  shown  at  100  meter  intervals.  The  7-elcvation 
is  scaled  ty  a factor  of  3,  The  location  of  the  villages  of  MEDEKROSO 
(Icwer  le'it)  and  RUCERROLLA  (upper)  are  sfic\.’n  by  tiie  asterisks,  Ttie 
view  is  from  a point  approxii.iately  20  km  back  at  a height  of  3,000  ft, 
with  a 15X  laagnification.  The  terrain  elevation  data  is  obtained  from 
the  defense  mapping  agency  (DMA)  in  UTM  grid  aligned  format.  At  CACDA 
we  currently  have  large  portions  of  central  V and  VII  corps  areas,  parts 
of  the  Morth  German  plains,  Gouth  ''orca,  Mid  East  (CAITG  terrain),  and 
selected  US  test  areas:  Fort  Hunter  Liggett,  Fort  Hood,  and  Fort  Ii'win 
(rot  on-line  yet).  These  terrain  data  bases  are  stored  on-line  (disc 
storage)  on  tlie  TRADOC  Data  Processing  Field  Office  (ORFO)  CDC  6400/0500 
computer  system  for  rapid  access  by  the  graphics  software. 

2.  Using  a digitircr  board  and  working  from  a map,  we  injnit  overlays 
of  the  rivers  (FULDA)  and  road  nets  for  the  terrain  area  (slice  3).  The 
AUTOSAHR  is  triple  lines,  double  lines  are  major  paved  roads,  daslied 
double  lines  are  secondary  roads.  The  various  overlays  developed  can  be 
built  upin  different  fashions.  This  slide  (slide  4)  shows  a cc:nbination 
of  the  river,  road,  and  rail  nets  together  with  an  operations  overlay. 

The  Blue  defense  is  developed  on  the  left  while  the  tlirc-at  axis  of 
approach  is  shewn  coming  from  the  east  towards  the  left. 
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3.  This  view  (slide  5)  is  a long  range  contour  perspective  of  the 
same  terrain  area  only  looking  from  the  east  towards  the  west,  i.e., 

from  the  direction  of  the  threat.  The  contours  are  drawn  at  20m  intervals. 
Vertical  elevation  exaggeration  is  the  same  as  before,  with  the  viewer 
standing  20  Ion  back  at  a height  of  3,000  ft.  The  river/road  overlays 
can  also  be  displayed  on  this  perspective  again  (slide  6).  The  river  and 
road  nets  with  the  operations  overlay  is  shown  in  perspective  without 
the  terrain  grid  (slide  7), 

4.  The  standard  2D  contour  map  is  also  included  in  the  computer 
software  (slide  8).  This  is  the  same  20  meter  contour  map  now  viewed  in 
2 dimensional  1 to  60,000  UIK  grid  map  fonnat.  The  river  and  road  net 
overlay  can  also  bo  applied  as  seen  in  slide  9. 

5.  Using  a vegetation/cultural  feature  code  supplied  by  DMA  allows 
a representation  of  these  features  to  be  applied  on  the  map  area  (slide 
10).  The  dark  asterisk  areas  show  forestation  features.  The  signs 
are  urban  or  built-up  arras  (villages,  etc.), 

C.  OrrCIlSE  PLAMMMG  AUD  SCUGARIO  DrvtbOr.MtNT.  using  this  type  of  i.'ap 
and  preceding  perspective  capabi 1 i ties , the  tactician  and  scenario 
developer  can  produce  a tactical  plan  for  defense  of  the  area.  This 
defensive  plan  is  shown  in  scheratic  form  on  this  overlay  (slide  11). 

The  next  step  in  the  DRS  sc'.  'ario  development  for  tl'e  CAiT'.O’U. ! TE  li  odel 
is  to  plan  each  defensive  area  in  detail  at  the  individual  vaapon  level, 
h'e  will  show  how  this  is  done  using  a typical  defensive  team  area. 

1.  First  we  blew  up  t!io  terrain  area  1:25,000  scale  (slide  12)  in 
front  of  the  team  area.  The  '..capon  locations  in  the  team  are  shown  as 
I'ttcrs.  D's  are  Dragons,  A's  arc  t.mks,  and  T's  are  TOW  systems.  The 
area  repr-.?ciited  is  approximately  a 4 x 5 Ian  area. 

2,  For  each  i eapen  f osition  we  then  can  generate  a LOS  map.  The 
first  shown  (slide  13)  is  for  a Dragon  position.  The  scan  is  set  to  500 
r '•■ters  past  ti’.e  l axinuin  erfoctive  range  of  the  Dragon  (1,000  + 500 
meters).  The  di'di.n  in  lines  indicate  intervisibility  with  tank/APC 
targ^'-ts  located  in  thiosc  regions.  The  Pracon  is  given  a 90°  field  of 
view  (FOV)  here,  with  t'",e  LOS  checked  at  incrc.ments  within  that  FOV. 

a.  All  of  the  Dragon  LOS  areas  are  shewn  next.  Wot  ice  that  the 
lOS  of  f'e  rear,  ard  Dragon  positions  are  limited  to  500  m.eters  or  less 
rxeept  for  about  a 10°  field  straight  ahead  to  the  east  (slide  14). 

b.  A similar  set  of  coverage  fans  is  si^own  for  the  three  tank 
positions  (m.axinum  range  of  1500  + 500  motors).  Again  note  the  m.ask 
regions  and  field  of  fire  r.-’strictions  (slide  15). 

c.  Th.e  8 TOW  positions  coverages  out  to  3,500  n.eters  are  sho.vn  in 
this  slide  (slide  16).  Tgain,  the  reduced  fields  are  evident  v.'ith  the 
raxinum  lOW  range  usable  only  to  the  far  left  flank  coverage. 

d.  To  illustrate  the  coverage  blockage,  the  forcstation  and  cultural 
features  are  cvrrl.ed  on  the  fOW  coverage  fans.  The  villages,  forc- 
staticn  cn  the  hilltops,  and  land  m.’sks  are  easily  identified  (slide  17). 
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3.  Similar  procedures  are  used  for  veapon  p1acei”ent  on  the  remaining 
teams  to  plan  the  entire  defense.  These  positions  are  tiien  input  into 
the  CARMONETTE  model  together  with  the  balance  of  the  tactical  plan. 

The  threat  plan  is  developed  using  the  same  techniques.  This  is  as  far 
as  v.'o  have  gone  in  the  Division  restructure  Study  planning  to  date. 

D.  ANALYSIS  OF  MODEL  RESULTS.  V.'e  now  switch  to  a previous  study,  the 
FASC/vM  COLA,  conducted  by  the  Combat  Operations  Analysis  Directorate  at 
CACDA,  to  illustrate  the  analysis  aspects  of  graphics,  but  first  we  will 
go  through  a similar  scenario  [ilanning  phase. 

1.  First,  a long  range  view  of  the  terrain  (slide  18),  this  time 
5 km  X 10  km  deep.  The  terrain  is  just  nortiioast  of  FULDA.  The  nmdel 
used  was  D>NTACS-X.  The  view  is  from  the  defense,  again  with  the  same 
elevation  exaggeration  used  in  the  previous  slides.  Now  a view  from  the 
defender’s  right  flank  (slide  19).  Another  from  the  left  flank  (slide 

20) .  And  rotating  tlie  tei'rain  180°,  a view  from  the  threat  side  (slie'e 

21 ) .  Again,  these  terrain  graphics  are  used  to  lock  for  anticipated 
threat  approaches,  major  hill  masks,  flanking  fire  position,  etc.,  in  a 
very  detailed  terrain  analysis. 

2.  Now  we  return  to  the  2D  contour  map  (slide  22)  given  for  a 5 x 
10  km  area  using  a UTM  grid  system. 

a.  The  4 defensive  teams  \.ere  positioned  as  shown  in  slide  23.  The 
active  defense  is  being  portrayed  in  the  scenario  and  later  I shall  show 
planned  withdrawal  routes  and  subsequent  team  locations. 

b.  Next,  slide  24  shows  the  coverage  of  the  area  for  a TOW  position 
in  Team  One.  Now  we  go  down  to  the  TOW  position  on  the  ground  and 
generate  a perspective  view  of  the  terrain  in  front  of  this  position 
(slide  25).  The  field  of  view  of  60°  with  the  elevation  enhanced  by  3. 
Notice  we  have  removed  the  hidden  lines  in  tlie  view.  The  perspective 
drawing  contains  about  4,800  vectors  (some  are  not  visible).  The 
previous  long  range  terrain  perspectives  did  not  have  the  hidden  lines 
rnreved.  Removing  those  hidden  lines  increases  the  required  co'^puter 
time. 

c.  Another  TOW  position  from  a second  team  area  is  shown  on  this 
view  (slide  26).  Note  the  flanking  long  range  fields  of  fire  as  they 
become  quite  important  in  the  analysis  of  the  model  results.  This  (slide 
27)  is  the  corresponding  TOW  ground  perspective  view.  In  this  position 
the  forward  slope  is  towards  the  left. 

3.  In  the  next  view  (slide  28)  we  have  added  planned  minefield 
locations,  shown  on  the  right  as  200  meter  boxes  with  numbers.  The 
minefields  are  planned  in  conjunction  with  the  \.eapon  coverage  to  insure 
covering  fire  or  obstacles  to  deny  the  threat  cover  in  potential 
defilade  positions.  Corresponding  artillery  fire  aim  points  were 
generated  by  similar  considerations.  We  also  show  the  planned  withdrawal 


routes  and  subsequent  occupied  positions.  Finally,  TOW  coverage  from  one 
of  the  secondary  positions  is  shown  in  conduct  of  the  active  defense. 
Notice  again  trie  flanking  coverage  obtained. 

4.  V.'e  now  switch  to  a long  perspective  to  illustrate  the  threat 
approach  (slide  29).  This  is  from  the  threat  direction  and  shows 
selected  Blue  defender  positions. 

a.  The  next  series  of  slides  (slides  30,  31,  32)  show  successive 
positions  of  threat  force  approach  trails  as  anticipated  in  t' e attack 
planning.  Boxes  are  drawn  at  30  second  intervals  along  the  trails. 

5.  Similar  views  can  be  generated  from  any  perspective.  To 
illustrate  wo  show  two  ground  views.  The  first  (slide  33)  is  the  same 
team  one  TOW  position  as  shown  before.  The  approaching  threat  trails 
are  shown  when  visible  to  tfte  defender.  The  same  display  for  the  TOW 
fi'om  position  2 is  shown  in  slide  34.  The  previous  scenario  preparation 
data  and  planning  inforration  was  used  to  set  up  various  run  sets  for 
the  DYwTACS-X  model . 

6.  The  next  series  of  slides  show  examples  of  how  tlie  graphics 
display  were  used  in  the  analysis  of  r-odel  results.  The  terrain  grid 
in  slide  35  is  the  same  as  previously  shown.  These  results  depict  the 
time  event  histewy  of  individual  model  replications. 

a.  This  gives  the  cumulative  history  of  events  to  a battle  time  of 
600  seconds.  The  pairing  lines  represent  kills.  Foxes  at  the  end 
indicate  the  firing  Blue  v, capon.  An  X with  a pairing  line  is  a Red 
i.eapon  killing  a Flue  defender  weapon.  The  minefield  bexes  are  FASCAM 
delivered  fields.  Fneountors  are  indicated  by  a r sign;  kills  by  an  X. 

b.  In  slide  36  the  battle  time  has  increased  to  1200  seconds. 

Regular  stars  indicate  a Blue  element  killed  by  Red  artillery.  Jagged 
stars  indicate  a Red  element  kill  by  Blue  artillery.  Across  the  top  is 
a 200  second  update  of  a killer/victim  scoreboard  including  LFR,  mine 
encounters,  and  mine  kills.  By  1,200  seconds  team  one  has  withdrawn  to 
its  secondary  position.  The  defenders  at  the  lov.er  left  have  just  begun 
to  Ofen  fire  on  threat  elements  on  their  left  flank. 

c.  The  situation  at  end  of  the  simulation  run  at  1,600  seconds  is 
shown  by  this  final  slide  (slide  37)  in  the  series.  A sumrNary  is  printed 
at  the  lower  part  of  the  screen.  In  the  battle  portrayed,  it  is 
interesting  to  note  the  preponderance  of  fire  from  flanking  positions 
which  correspond  to  the  increased  fields  of  fire  seen  in  the  LOS  fans. 
Additionally,  few  Blue  kills  of  Red  elements  occur  from  the  initial 

posi tions. 

7.  The  use  of  graphics  and  the  time  dimension  portrayal  (which  we 
can't  really  show  using  slides)  has  proved  invaluable  in  model  checkout 
and  analysis.  Both  responsiveness  and  con ‘‘idcnce  in  results  v.ere 
greatly  increased  even  though  we  wore  using  rudimentary  application 
software  and  were  developing  as  we  went  along. 


8.  Tf.G  next  two  slides  illustrate  another  display  technique  suited 
for  intcrvis ibi 1 i ty  studies.  Here  (slide  38)  we  show  simulated  threat 
.chicle  approach  trails  towards  a series  of  defenders  indicated  by 
hers  on  the  right.  These  trails  were  generated  by  the  UYMACS-X 
bility  I'odel  for  tlie  HriLFlRf  CCTA  Study  conducted  by  CACDA.  Using 
the  I OS/I'.obi  1 ity  driver  code  of  DYUTACS,  we  can  then  display  only  the 
visible  p^ths  for  selected  defender  elecr-nts.  This  overlay  (slide  39) 
slicw's  tliG  intci  visibi  1 ity  from  defender  position  element  no.  1.  b'hen 
these  displays  are  geriorated  on  the  CRT  screen,  the  approach  is  time 
s'-qucnced.  Thus,  both  the  static  and  dyi.anic  geo.'etry  of  intervisibility 
is  readily  available  for  analysis.  Statistics  involving  segrrent  length 
correldticn  effr'cts  and  multiple  intervisibi  1 i ty  sequences  can  be 
visually  oai.ined  in  the  original  frasi'work , before  data  aggregation 
techniques  are  used. 

T.  FIKLD  FXl-FRIHFuT  /V.ALYSIS.  Tiie  next  series  of  slides  very  quickly 
illustrates  an  application  to  field  rxpcrii  c-nt  test  analyses.  This  (slide 
■ 0)  is  a Iciig  range  view  of  a 5 x 10  Im  area  at  Fort  Hunter  Liggett 
Cali  Tot  Ilia,  the  'Site  A and  B (TETAM)"  area  is  to  the  lower  left  for 
those  of  you  familiar  with  the  area  and  the  TFTAM  tests.  The  example 
test  we  used  is  the  ATKT  test  conducted  by  CDEC  at  Fort  Hunter  Liggett 
from  October  through  nocc  ber  1975  to  examine  TOX'  gunner  tracking 
capability  against  evasive  target  vehicles.  Using  the  digitized  terrain 
as  a hach.ground , we  added  tiie  test  data  taken  which  provides  a 
I i.ci  c-ation  of  tiie  trial  gs-oi'.Gtry  and  time  sequence. 

1.  This  is  a ground  perspective  view  from  a TOX  gunner  position 
alcng  a ridge  line  at  Site  A (slide  41).  In  this  next  slide  (slide  42) 
wc-  have  now  overlayed  an  approaching  target  vehicle's  path  on  the 
terrain.  Successive  boxes  are  drawn  at  10  second  intervals  if  the 
target  is  visible  as  deteiTiined  by  the  terrain  LOS  rodel. 

2.  Slide  43  is  anot'ier  view  to  illustrate  the  trial  as  viewed 
from  a simulated  helicopter  position  to  the  left  flank  and  fon/ard. 

The  cembination  of  the  test  data,  position  location  data  and  the  terrain 
[ese  allows  for  a significant  increase  in  understanding  the  conduct  of 
a field  experiment,  a rapid  data  reduction  process,  and  an  increased 
perception  of  the  tactical  parameters  influencing  the  results. 

3.  Xe  are  currently  expanding  and  exploring  field  experiment 
analysis  using  graphics  techniques  in  support  of  the  Division  Restructure 
battalion  test  at  Fort  Hood,  Texas. 

F.  SUiT-iARY. 

a.  The  next  three  slides  (slides  44,  45,  46)  illustrate  a portion 
of  our  on-line  data  base.  They  are  20  km  x 20  km  long  range  perspectives 
locking  east  towards  the  border  in  the  central  Europe  V corps  region. 

Xe  are  constantly  increasing  our  on-line  terrain  data  base  and  expect  to 
expand  it  significantly  in  scope  as  well  as  detail  in  connection  with 
on-going  DMA  digitizing  programs. 
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2.  The  previous  slides  shown  are  representative  of  the  preliminary 
work  we  are  doing  in  graphics.  Our  equipment  consists  of  two  Tektronix 
4051  graphics  display  calculator  systems  and  a 4014  19"  display  terminal. 
We  will  be  increasing  our  graphics  capability  significantly  with  the 
addition  of  two  Tektronixs  4081  intelligent  graphic  terminal  systen>s  and 
four  19"  Ramtek  color  display  systems  driven  off  of  a Varian  V77  mini- 
computer system.  This  all  will  be  linked  to  the  DPFO  COC  6400/5500  at 
Fort  Leavenworth. 

3.  Rased  on  our  limited  experiences  with  graphics  applied  to 
traditional  Anny  ORbA  problems,  we  are  quite  confident  the  technique  is 
sound.  Our  results  to  date  have  been  rewarding.  We  are  experiencing 
an  increased  responsiveness,  increased  level  of  infonnation  transfer 
between  study  advisors/decision  makers  and  analysts,  and  increased 
confidence  in  understanding  our  combat  models. 
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TITI.K  : A Mil  i horn  at  lea  1 rfoj^riuimiiii)’,  Moilel  tor  an  Airoralt  NoJi  1 i oat  ion 

l’rogr;ini 

ArTH(>K : Dr.  I’riiiik  Fox 

ABS  TKACT : A hirgi'  tioot  ot  airoralt  l.s  to  bo  moililioil  by  tlio  in.'^tiilla- 

tion  on  oaoh  ;iiror;itt  in  tbo  tloot  of  a certain  luiiiilu-r  of  onginooring 
obangt’  proposiil  (lit:!’)  kits.  'I'bo  airoraft  are  dopli'yoil  in  siiuiller  sub- 
flo'ots,  called  liold  units,  at  v;irious  locations  around  the  wiirld,  and 
tile  kit  insta  11  ;it  ions  are  to  t;ike  place  at  ;i  single  oontr;iotor  facility. 
I'heretore,  each  of  the  ;iiroraft  must  be  taken  out  of  opor;itiou  in  tiie 
field  ;md  sent  in  to  tlie  contractor  f;ioility  tor  mod  i f i oiit  ion . 

Filch  field  unit  has  an  iiuthorlzed  strength  of  ainraft  with  a speci- 
fied operational  reiidiness  to  mijintain,  permitting  only  a certiiin  number 
of  aircraft  to  tie  awiiy  from  eiich  fielil  unit  iit  a given  time.  i'urtlier- 
more,  FCI’  kits  become  iivailalile  over  ii  perliul  ot  time.  At  the  beginning 
of  the  progriUii  only  certiiin  types  of  kits  ;ire  aviiihible,  iind  the  List  type 

of  kit  doesn't  become  iivailabie  until  sonu’  t i nii'  later.  Therefore,  iin  air- 

craft sent  in  for  modification  eiirly  in  tlie  progi'iim  will  not  get  all  of 
the  F.Cl’  kits  and  must  be  sent  back  at  leiist  a second  time. 

In  order  to  maintiiin  oper;illonal  readiness,  the  iiinriift  should  be 
sent  in  as  few  times  as  possible  ;ind  brought  biick  ;is  (luickly  as  possible. 

On  the  other  h;ind,  aircr;ift  can  be  ill  lowed  to  wiiit  at  the  cini  t fiictor 
facility  until  addilion.il  IICT  kits  become  aviiiliible  iimi  ciin  bo  installed. 
Hence,  there  iire  reiisons  for  bringing  the  aircriift  biick  from  the  contrac- 
tor facility  as  quickly  as  (lossible  and  iilso  risisons  for  leiivlng  them 
there  for  extrii  periods  of  time. 

An  optimum  solution  to  the  problem  of  how  miiny  aircraft  should  be  sent 

in  and  for  how  long  they  should  ri'niiiin  Ciin  be  developed  using  nuithemat  i c.il 

programming.  In  this  piiper  iin  integer  programming  model  consisting  ot 
constraints  and  an  objective  tunction  is  deveU'ped,  making,  it  possible  ti’ 
niiiximize  the  number  of  kits  institlled  on  the  fleet  of  aircfiitt  in  a given 
period  of  time.  The  solution  obtained  from  tlie  model  permits  a kit  in- 
stallation schedule  to  be  developed.  'The  schedule  will  g,ive  tor  each 
field  unit  the  number  of  aircraft  to  be  sent  in  each  month  and  the  month 
in  which  they  will  be  returiu'd  to  the  field  unit.  'The  model  has  .ipplica- 
tion  to  scheduling  problems  of  the  type  described  aln've  and  will  be  use- 
ful in  tlie  solution  of  similar  problems. 
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A MATHEMATICAL  PROGRAMMIEC  MODEL  FOR  AN  AIRCRAFT 
MODIFICATION  PROGRAM 

DR.  FRANK  FOX 

US  ARMY  AVIATION  RESEARCH 
AND  DEVELOPMENT  COMMAND 


1.  INTRODUCTION 


A large  fleet  of  aircraft  is  to  be  modified  by  the  installation  on 
each  aircraft  in  the  fleet  of  a certain  number  of  engineering  change 
proposal  (ECP)  kits.  The  aircraft  are  deployed  in  smaller  sub-fleets, 
called  field  units,  at  various  locations  around  the  world;  and  the  kit 
installations  are  to  take  place  at  a single  contractor  facility.  There- 
fore, each  of  the  aircraft  must  be  taken  out  of  operation  in  the  field 
and  sent  in  to  the  contractor  facility  for  modification. 

Each  field  unit  has  an  authorized  strength  of  aircraft  with  a speci- 
fied operational  readiness  to  maintain,  permitting  only  a certain  number 
of  aircraft  to  be  away  from  each  field  unit  at  a given  time.  Furthermore, 
ECP  kits  become  available  over  a period  of  time.  At  the  beginning  of  the 
program  only  a certain  type  of  kits  are  available,  and  the  last  type  of 
kit  doesn't  become  available  until  some  time  later.  Therefore,  an  air- 
craft sent  in  for  modification  early  in  the  program  will  not  get  all  of 
the  ECP  kits  and  must  be  sent  back  at  least  a second  time. 

In  order  to  maintain  operational  readiness,  the  aircraft  should  be 
sent  in  as  few  times  as  possible  and  brought  back  as  quickly  as  possible. 
On  the  other  hand,  if  an  aircraft  is  allowed  to  wait  at  the  contractor 
facility  until  additional  ECP  kits  become  available  and  can  be  Installed, 
it  can  be  returned  to  the  field  unit  with  more  modifications,  making  it 
better  able  to  perform  its  mission  and  perhaps  also  eliminating  a future 
trip  to  the  contractor  facility  for  those  modifications  for  which  it 
waited.  Hence,  there  are  reasons  for  bringing  the  aircraft  back  from  the 
contractor  facility  as  quickly  as  possible  and  also  reasons  for  leaving 
them  there  for  extra  periods  of  time. 

An  optimum  solution  to  the  problem  of  how  many  aircraft  should  be 
sent  in  and  for  how  long  they  should  remain  can  be  developed  using 
mathematical  programming.  In  this  paper  an  integer  programming  model 
consisting  of  constraints  and  an  objective  function  is  developed,  making 
it  possible  to  maxmlze  the  number  of  kits  installed  on  the  fleet  of  air- 
craft in  a given  period  of  time.  The  solution  obtained  from  the  model 
permits  a kit  Installation  schedule  to  be  developed.  The  schedule  will 
give  for  each  field  unit  the  number  of  aircraft  to  be  sent  in  each  month 
and  the  month  in  which  they  will  be  returned  to  the  field  unit.  The 
model  has  application  to  scheduling  problems  of  the  type  described  avove 
and  will  he  useful  in  the  solution  of  similar  problems. 

2.  ASSUMPTIONS 


When  constructing  a model  it  is  desired  to  model  the  actual  physical 
situation  as  closely  as  possible.  However,  it  is  often  Impossible  to 


model  all  aspects  of  a situation  in  complete  detail.  Certain  assumptions 
were  nude  here  in  order  to  include  as  much  complexity  as  possible  whi  !(> 
still  keeping  tlie  model  manageable. 

Tlie  kit  installation  program  will  run  for  a certain  number  of  time 
periods.  A time  period  can  be  any  fixed  lengtli  of  time  such  as  a month, 
quarter,  year,  etc.  For  convenience  of  expression  let  tlie  time  periods 
be  months  and  let  the  length  of  tlie  program  be  T months. 

First,  it  is  assumed  that  at  the  beginning  of  the  program  all  of  the 
aircraft  are  in  need  of  all  the  kits.  Also  it  is  assumed  that  the  kits 
are  numbered  according  to  availability;  the  first  type  of  kit  available 
is  kit  number  1,  the  second  type  of  kit  available  is  kit  number  2,  etc. 
Further,  it  is  assumed  that  for  each  type  of  kit  there  is  a month  in  which 
that  kit  becomes  available  in  whatever  quantities  it  is  needed  from  then 
on . 

In  practice  the  monthly  demand  for  kits  is  probably  uniform  enough  to 
make  this  a reasonable  assumption. 

Hence,  the  following  table  of  kit  availability  can  be  constructed. 

Table  1.  TABLE  OF  KT  J AVA11..\BILITY 

MONTH  1 2 3 4 . . . T 

KIT  Iq  Iq  K Iq  ...  Kj’ 

The  table  has  the  following  Interpretation.  All  aircraft  shipped 
from  the  contractor  facility  in  the  1st  montii  will  have  recieved  kits 
1 through  Kj^  , those  shipped  in  tlie  2nd  month  will  have  received  kits  1 
through  K2  , those  shipped  in  the  3rd  month  will  have  received  kits  1 
through  K3 , etc.  If  all  the  kits  become  available  before  the  T*-*'  month, 
there  will  be  some  month  c such  that  from  the  c*-''  month  on  all  aircraft 
shipped  from  the  contractor  facility  will  have  all  kits. 

Implicit  in  this  assimiption  is  the  assumption  that  while  an  aircraft 
is  at  the  contractor  facility,  it  receives  all  of  the  kits  which  are 
available  before  it  is  shipped  back.  Furthermore,  it  is  assumed  that 
the  installation  time  for  all  groups  of  kits  is  the  same,  no  matter  how 
many  kits  there  are  in  a group. 

In  order  to  decrease  the  number  ot  possibilities  represented  by  the 
variables  it  is  assumed  that  an  aircraft  will  be  sent  in  no  more  than 

twice.  Also  no  aircraft  at  a field  unit  will  be  sent  in  the  second  time 

until  every  aircraft  at  the  field  unit  has  been  sent  in  once.  Further- 
more, no  alrcaft  will  be  sent  in  the  second  time  until  it  can  have  all 
of  its  remaining  needed  kits  installed  without  any  waiting  time  (in  other 
words  until  the  earliest  month  in  which  it  would  he  shipped  from  the  con- 
tractor facility  is  the  month  or  later)  . 

Let  Xijk  = the  number  of  aircraft  sent  in  for  the  first  time  from 

the  I*-*'  field  unit  in  the  month  which  are  shipped  back  from  the  con- 

tractor facility  in  the  k*^"  miinth,  and  let 

Yljk  = the  number  of  aircraft  sent  in  for  the  second  time  from 
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the  field  imit  in  the  j month  which  are  shipped  back  from  the  cont- 
ractor facility  in  the  k*-^^  month. 

The  subscripts  j and  k are  used  to  indicate  the  month  j in  which  the 
aircraft  are  sent  in  for  modification  and  the  month  k in  which  the  aircraft 
are  shipped  back  from  the  contractor  facility.  A given  subscript  j may 
have  many  associated  values  of  k which  in  effect  allows  the  aircraft  to 
stay  at  the  contractor  facility  for  various  lengths  of  time,  premitting  it 
to  wait  at  the  contractor  facility  until  additional  kits  become  available 
and  can  be  installed. 

3 . PERMISSIBLE  VARIABLES 

In  the  variable  the  subscript  j respresnts  the  month  in  which 

the  aircraft  are  shipped  to  the  contractor  facility,  and  the  subscript  k 
represents  the  month  in  which  the  aircraft  are  shipped  from  the  contractor 
facility.  Therefore,  the  value  of  j must  always  be  less  than  the  value  of 
k,  limiting  the  possibilities  for  subscripts  to  certain  values. 

Let  Sj^  be  the  transportation  time  for  an  aircraft  to  be  shipped  from 
the  i*^^  field  unit  to  the  contractor  facility,  and  assume  that  the  trans- 
portation time  for  shipment  back  to  the  field  unit  is  also  Sj^.  Let  p be 
the  installation  time  for  a group  of  kits.  Recall  that  p is  independent 
of  the  number  of  kits  in  a group. 

If  an  aircraft  is  shipped  in  during  the  j month,  it  will  arrive 
at  the  contractor  facility  in  the  j + month  and  take  p months  to  be 

processed.  Therefore,  the  first  month  in  which  it  can  be  shipped  from  the 
contractor  facility  is  the  j + Si  + pthmonth.  However,  since  an  aircraft 
is  allowed  to  wait  at  the  contractor  facility  for  the  availability  of 
additional  kits,  it  may  not  be  shipped  back  in  the  j + Si  + p*^^  month. 

That  month  or  any  later  month  is  a possible  shipping  month.  Hence,  the 
variable  cannot  have  a subscript  k with  k < j + Sj^  + p , thereby 

limiting  the  variables  which  can  occur  to  those  listed  in  the  following 
table . 

Table  2.  TABLE  OF  PERMISSIBLE  SUBSCRIPTS  FOR 


^,l,l^Si+p 

Xi,l,2+Si+p 

^i  ,1,3+Sj^+p 

^l.l.T 

Xi,2,2+Si+p 

Xi,2,3+Si+p 

^i,2,T 

%,3,3-^Si+p 

. . . 

^i,3,T 

%,T-Sj-p,T 

Recall  that  there  is  some  month  c such  that  all  aircraft  shipped  from 
the  contractor  facility  in  the  c^h  month  or  a later  month  will  have  had 
all  the  kits  installed.  Further,  it  was  assumed  that  aircraft  are  not 
sent  in  for  a second  time  until  all  kits  are  available.  Specifically, 
the  aircraft  which  are  sent  in  for  the  second  time  will  not  be  sent  in 
before  the  month  which  permits  c to  be  the  first  month  in  which  they 
could  be  shipped  from  the  contractor  facility.  Since  the  shipping  time 


from  ti\e  field  unit  is  S|  and  tlio  piocossinj;  time  is  p , in  the  vari- 
able it  is  necessary  that  J > c - - p.  Furthermore,  since  an 

aircraft  sent  in  for  the  second  tirjo  receives  all  the  remaininR  needed 
kits,  there  is  no  need  lor  it  to  stay  at  t!ic  contractor  facility  longer 
than  the  p months  necessary  to  install  the  kits;  in  other  words,  there 
is  no  waiting  time  for  additional  kits.  Therefore,  the  subscripts  on 
^'ijk  limited  to  those  listed  in  the  following  table. 

Table  3.  TABLE  OK  FKRMISSI  Bl.E  Sl’BSCRll’TS  FOR  Y.jj, 

'''i  ,c-Si-p  ,c  ' i .c-Sp-p+l  ,c+l  •••  'i,r-Si-p,'r 

An  alternative  to  liaving  a list  of  permitted  subscripts  would  be 
to  allow  all  subscripts  to  be  used  and  to  impose  the  constraint  that  the 
inadmissible  variables  have  the  value  zero.  However,  this  method  was  not 
used  in  order  to  keep  the  number  of  variables  and  constraints  used  to  a 
minimum. 


A.  AIRCRAFT  AVAILABILITY  CONSTRAINT 


At  each  field  unit  there  are  a certain  numbei  of  aircraft.  In  essence, 
the  aircraft  availability  constraint  prevents  more  aircraft  from  being 
sent  in  from  a given  field  unit  tlian  there  are  aircraft  at  that  field  unit. 
However  in  applying  this  constraint,  it  is  not  .satisfactory  to  simjily  count 
tile  number  of  a aircraft  sent  in,  because  some  aircraft  are  sent  in  twice. 
Therefore,  it  is  necessary  to  have  two  separate  constraints,  one  for  those 
aircraft  being  sent  in  for  the  first  time  and  one  for  tliose  being  sent  in 
for  tlie  second  time. 


Let  = the  number  of  aircraft  stationed  at  the  i^''  field  unit  at  tlie 
start  of  the  modification  program.  For  each  field  unit,  the  total  number 
of  aircraft  sent  in  for  tlio  first  tine  during  the  T months  of  tlie  program 
must  be  less  than  or  equal  to  Nj  . As  an  inequality  the  constraint  is 
written 


YL  E ’ 

j k 


(la) 


for  each  field  unit  i.  The  left-hand  side  of  (la)  represents  the  total 
number  of  aircraft  sent  in  for  the  first  time  during  the  T months  of  the 
program.  In  order  to  avoid  cumbersome  expressions  in  tlio  limits  of  the 
summation  notation,  the  limits  are  sometimes  ommitted.  If  no  limits  arc 
given  a summation,  it  is  to  bo  understood  that  tlie  sum  is  over  .ill  per- 
missible values  eif  the  subscript.  For  example,  the  lei  t hand  side  of 
equation  (la)  represents  the  siini  over  all  permissible  svibservpt  j and  k 
for  in  other  words  over  all  values  listed  in  Table  3. 

If  all  the  kits  become  available  for  ins tal  l.i t i on  before  the  T*-'’ 
month,  there  will  be  some  month  c such  that  all  aircraft  shipped  for  tho 
contractor  facility  in  the  cih  month  or  a later  month  will  have  all  the 
kits  Installed,  In  other  words,  any  group  Xijk  of  a aircraft  with  k > c 
will  have  all  the  kits  installed  tlie  first  time  they  are  sent  in  and  will 
not  go  in  a second  time.  Therefore,  not  all  the  aircraft  are  possibil- 
ities for  being  sent  in  a second  time,  and  the  number  of  aircraft  avail- 


able  to  be  sent  in  a secontl  time  must  be  decreased  by  the  number  wlilch  have 
all  the  kits  installed  the  first  time.  The  number  of  aircraft  from  the 
if''  field  unit  wiiich  li.ive  all  the  kits  Installed  the  first  time  Is 


I k 

Hence  the  constraint  is  written  as 

E E^’ijk^  - E E "^ijk 

J k j k 

for  each  field  unit  i. 


Ub) 


5.  0PKRAT10N.M.  KE^dUNK SS  CONSTRAINT 


In  each  liold  unit  some  of  the  aircraft  can  bo  away  from  the  field 
unit  for  ECP  kit  installation.  However,  in  order  to  maintain  the  required 
operational  readiness  of  the  fleet,  there  is  a limit  on  the  number  of 
aircraft  which  can  be  away  at  any  given  time. 

het  Mi  = the  number  of  aircraft  which  can  be  away  from  tlie  i*"''  field 
unit  for  IX:P  kit  installation  when  there  are  Ni  aircraft  assigned  to  the- 
field  unit.  The  operational  readiness  constraint  is  that  the  number  of 
aircraft  away  from  the  if*'  field  unit  in  eacli  month  must  be  less  than  or 
eqvial  to  Mj  . 


.\n^^expression  is  needed  for  the  number  of  aircraft  which  are  away  from 
the  i ' field  unit  during  the  r*-*’  month.  Those  wliich  will  be  away  during 
the  rth  montli  are  those  wliich  are  sent  in  during  the  ri''  month  or  earlier 
and  which  have  not  returned  by  the  r*-'’  month.  In  order  to  arrive  back  at 
tbe  field  unit  in  the  rf''month,  an  aircraft  must  he  shipped  from  the  con- 
tractor facility  in  the  r - month.  Honco , for  the  variable 

if  k > r - Sj  . the  aircraft  will  not  have  returned  to  the  field  unit  by 
the  rth  month. 


The  number  of  aircraft  away  from  the  i'^*'  field  unit  during  the  r^'' 
month  will  first  bo  establlslied  for  the  variables  Nj^jk  f'N  ’"onth  for  the 
months  in  which  they  are  sent  in  from  the  field  unit.  The  number  away 
from  tlie  field  unit  in  the  r*-*'  month  wliich  were  sent  In  during  the 
T''*'  month  is  i- 


+ ^1,1, T 


E -^iik 

k=qi 


where  q^^  is  the  larger  of  the  two  numbers  r - Sj  + 1 and  1 + Sj^+p . 

It  is  necessary  that  r - Sj+l  so  that  the  aircraft  will  not  have 

returned  to  the  field  unit  by  the  r^''  month,  and  it  is  necessary  tliat 
gj  > 1 + Rl+P  because  Sj+p  is  the  mininium  time  for  aircraft  to  be  sent  in 

and  have  kits  install  oil. 


The  number  away  f pirn  the  field  unit  in  the  rf''  niontli  winch  were 


sent  in  during  the  month  is 


■'‘i,2,qT  ^l,2,qi+l  ^ ‘''i,2,q2+2 


+ ...  + X 


r 

i,2,T  = E''^i2k 
k=q.. 


where  q^  is  tlic  larger  of  r-Si+1  an.1  1+S^ ‘-p . 
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■■  + X 
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r..  kj  ‘'ece< 

"T'--  -strefot  eo„ 

.ITb-Uhe^,  ^“"^"--..es 

''-‘Jl  ‘^i2k  +...  + p r 

each  flejj  k-  ^ 2L^  ^1  i ■ 

o - jp 

~ max  /r-.s  +,  ' month  r w; 

' ^ » J+S,+,yl  , 
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ZV:,  « 4e^7;’fr,‘:T  ^"""44,;“^  '"e  _ 

ontn,.  snn.  ‘he  var.-.,k, 


Por  air  '■  i{  n'  if  i ' 

■contractor  f ®‘cnt  In  f '’‘‘tiahle  \-,  ^ 

■•ot-  facliif.,  . ‘■^t  the  f,-  tjk 

?».f,r.,  f ; : -TL  .her  Of  o,rer„tt 

y i>l,r+2  + ...  + V ‘ "'t  t 

'i>l,T 


^f.2,r+i  + x 

^’-•t+2  + . , . + .. 
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‘ , I'fJ  + . . . ,,  r-s- 
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The  sum  on  j includes  all  possible  montlis  in  wliich  the  aircraft  can  be 

shipped  in  and  have  arrived  by  the  r^^^^  month,  namely  months  1,  2,  3 

r-S^.  The  sum  on  k includes  all  possible  shipping  montlis  after  the  r^*’, 

namely  months  r+1,  r+2 T.  The  sum  on  i includes  all  the  field  units. 

Further,  the  subscripts  are  limited  to  pennissible  values;  for  example 
r-Sj^,r+l  would  not  occur  unless  p=l,  since  the  smallest  pennissible 
value  of  k in  X^jj^  is  j+S^+p. 

For  the  aircraft  sent  in  for  the  second  time  the  number  which  will  be 
at  the  contractor  facility  in  the  rth  month  is 

'^i,q+l,q+^l+P+l  ‘ ,r-Si  ,r+p) 

C Y1  '^i.j.j+Si+p 

^ j=q 

where  q = max  { r-S^-p+l,  c-Sj^-p  j . It  is  necessary  that  q > c-Sj^-p, 
because  c-Sj^-p  is  the  smallest  permissible  value  of  j in  and  it  is 

necessary  that  q > r-Si-p+]  in  order  that  the  aircraft  will  not  have  been 
shipped  back  by  the  r^“  month. 

Hence,  the  constraint  is  written  as 

E[  t 

i '-k=r+l  j = l j=q 

for  each  month  r where 
q = max  f r-S^^-p+l,  c-S^-p  j . 

Recall  that  is  the  number  of  aircraft  that  can  be  away  from  the  ith 
field  unit  in  the  rth  montti.  Then  is  the  total  number  wliich  can  be 

away  from  all  the  field  units  in  the  rt*'  month  and  lienee  the  maximum 
number  which  could  be  at  the  contractor  facility.  If  ^[^Mi  < Fr  for  each 
month  r,  then  the  contractor  facility  capacity  constraint  is  automatically 
satisfied,  and  in  that  case,  it  can  be  omitted  in  the  formulation  of  the 
problem. 

7.  APPl.ICATION  CONSTRAINT 

There  may  be  some  reason  why  aircraft  from  certain  field  units  are 
selected  first  by  the  model  for  kit  installation.  For  example,  the 
transportation  time  or  cost  from  an  overseas  location  might  be  so  much 
greater  than  those  for  other  units  that  in  the  optimization  process  they 
would  not  be  selected.  However,  those  overseas  aircraft  might  be  the  ones 
whose  modification  was  most  desired.  Tlierefore,  there  is  an  application 
constraint  which  requires  that  at  least  a certain  number  of  aircraft  from 
each  field  unit  will  have  some  kits  installed. 

For  example  the  constraint  might  require  that  ono-flfth  of  all  the 
aircraft  at  each  unit  have  some  kits  installed;  or  it  raiglit  require  that 
all  the  aircraft  at  one  particular  unit  have  some  kits  installed  and  that 
one-third  of  the  aircraft  at  the  other  units  have  some  kits  installed. 
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Care  must  be  exercised,  however,  not  to  impose  such  a demanding  constraint 
that  a feasible  solution  is  impossible. 


For  each  field  unit  i,  let  A be  the  number  of  aircraft  which  must 
liave  at  least  some  kits  installed.  Then  the  constraint  becomes 

H -'^ijk  > h 

J,k 

for  each  field  unit  i,  and  the  summations  on  j and  k are  taken  over  their 
permissible  values. 

8.  OBJECTIVE  Fl’NCTION 

An  objective  function  must  be  selected  whicli  will  cause  tlie  optimiza- 
tion of  some  feature  of  the  modification  program.  Two  choices  wliicli  come 
immediately  to  mind  are  minimizing  the  cost  of  the  program  and  minimizing 
the  out  of  service  time  of  the  aircraft.  However,  if  the  cost  is  mini- 
mized, the  optimum  solution  is  to  install  no  kits.  Then  the  cost  is  zero 
and  has  been  minimized.  If  the  application  constraint  is  applied  to 
specify  a minimum  number  of  aircraft  v^hich  must  be  modified,  minimizing 
the  cost  will  limit  the  modified  aircraft  to  the  minimum  specified  number. 
This  is  contrary  to  the  desired  result  which  is  to  modify  as  many  air- 
craft as  possible  while  keeping  the  cost  to  a minimum.  Minimizing  the 
out  of  service  time  produces  a similar  result,  send  in  no  aircraft  or 
send  in  the  minimum  number  of  aircraft. 


Therefore,  it  was  decided  to  use  the  following  objective  function: 
i.j  ,k 

where  the  coefficients  Aij^  and  are  weight  factors  which  don't 

necessarily  sum  to  one.  The  relative  sizes  of  the  weights  can  be  chosen 
to  indicate  the  relative  importance  of  having  kits  installed  on  the 
corresponding  groups  of  aircraft,  .A.11  that  remains  is  to  make  a suitable 
choice  for  the  weights.  Two  possible  choices  are  discussed. 


One  possible  choice  for  the  weights  is  = B^j|^  = 1 for 

and  k.  Then  tb.c  objective  function  represents  the  total  number 
craft  modified  where  aircraft  sent  in  twice  are  counted  twice, 
it  is  possible  to  maximize  the  number  of  aircraft  modified. 


all  i.j, 
of  air- 
Hence , 


If  = 0 for  all  i,j,  and  k,  the  objective 

r 

'^IjkXijt^.  For  each  variable  the  weight 

i » j >k 


function  becomes 
'^ijk  chosen 


to 


be  the  number  of  kits  installed  on  the  corresponding  group  of  aircraft. 
Since  the  number  of  kits  installed  is  determined  entirely  by  the  subscript 
k,  the  coefficients  A^jj^  are  obtained  from  the  table  of  kit  av.ii  labi  li  ty 
(Table  1).  Hence,  the  objective  function  represonts  the  nnmher  of  kits 
installed,  making  it  possible  to  maximize  the  number  of  kits  installed. 
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If  some  of  the  Yijk.  ^“-*1  zero,  an  objective  function  representing 
the  number  of  kits  installed  can  not  always  be  obtained.  Aircraft  sent 
in  for  the  second  time  will  have  all  the  remaining  needed  kits  installed. 
However  in  general,  before  a solution  to  the  model  is  obtained,  there  is 
no  way  of  knowing  how  many  kits  the  aircraft  will  have  installed  the 
first  time  they  are  sent  in  and  tlierefore  no  way  to  know  how  many  kits 
will  be  installed  the  second  time.  In  order  to  obtain  an  objective 
function  in  this  case,  let  be  the  number  of  kits  installed  on  the 

group  .Xijk  and  choose  to  be  an  estimation  of  the  number  of  kits 

installed  on  the  group  Yljk*  example,  if  each  aircraft  is  to  have 

K kits  installed  during  the  modification  program,  might  be  taken 

to  be  2 for  all  i,  j,  k.  Then  the  objective  function  will  b'  an 
approximation  to  the  total  number  of  kits  which  are  installed. 

With  tlie  objective  function  just  described,  a solution  to  the  model 
can  be  obtained.  From  the  solution,  an  improved  estimate  for  the  B^jk 
can  be  made.  These  new  values  for  B^jk  can  be  used  to  obtain  a second 
solution  to  the  model.  This  iteration  process  can  be  continued  if 
desired.  However,  there  is  no  certainty  that  improvements  will  occur 
after  the  second  solution.  Furthermore,  the  choice  of  the  Bj^jk  may  not 
be  critical.  Therefore,  it  may  be  satisfactory  to  stop  with  tlie  second 
or  even  the  first  approximation. 

If  the  number  of  aircraft  processed  is  maximized,  that  puts  a pre- 
mium on  a large  number  of  aircraft  with  perhaps  only  a few  kits 
installed  on  each.  Whereas  maximizing  the  number  of  kits  installed 
necessitates  installing  more  kits  on  fewer  aircraft.  Maximizing  the 
number  of  aircraft  processed  might  result  in  an  aircraft  being  sent  in 
for  only  one  kit.  While  maximizing  the  number  of  kits  might  result  in 
the  aircraft  waiting  at  tiie  contractor  facility  until  more  kits  are 
available.  Therefore,  it  is  considered  better  to  maximize  the  number 
of  kits  installed. 

9.  SOLUTION 

The  model  is  an  integer  programming  model.  In  all  but  the  most 
trivial  case,  the  solution  would  be  too  involved  to  obt;  in  manually, 
and  therefore  requires  a computer  procedure.  Once  a solution  is 
obtained,  it  consists  of  values  of  Xj^jk  and  Xj^jk  for  all  permissible 
subscripts  i,  j,  k.  Recall  tiiat  1 designates  the  field  unit,  j the 
month  In  which  tlie  aircraft  are  sent,  k the  month  in  which  they  are  sent 
and  X and  Y the  number  of  aircraft  for  the  first  and  second  times, 
respectively.  Therefore,  a solution  to  the  model  is  a list  by  field 
unit  of  how  many  aircraft  are  to  be  sent  in  each  month  for  the  first 
and  second  times.  The  list  also  includes  the  montli  in  wliich  they  are 
sent  back. 

10 . VARIATIONS 

There  are  at  least  three  important  changes  which  can  be  made  in  the 
model  as  it  has  been  described  so  far. 
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First  it  is  possible  to  include  a cost  constraint.  It  is  necessary 
to  determine  the  cost  of  installing  each  kit  and  the  transportation  cost 
of  shipping  an  aircraft  from  each  field  unit  to  the  contractor  facility. 
Then  an  expression  can  be  obtained  for  ttie  cost  expended  for  an  inte'vil 
of  time,  for  example  one  year.  The  cost  constraint  can  then  be  writtc  , 
limiting  the  expenditures  in  each  year  to  a specified  amount.  Tiic  ar  ’unt 
of  course  could  vary  from  one  year  to  the  next.  If  desired,  it  is  al^^  • 
possible  to  specify  that  at  least  a minimum  amount  be  spent  each  year . 

A second  variation  which  can  be  made  in  tlie  constraints  is  to  allow 
the  number  of  aircraft  at  a field  unit  and  hence  the  number  of  aircraft 
which  can  be  away  from  that  field  unit  at  any  given  time  to  vary.  Ihis 
would  permit  the  introduction  of  new  aircraft  ipt-o  the  fleet  or  the 
removal  of  aircraft  from  the  fleet. 

The  final  variation  is  the  most  important.  When  the  original  model 
was  developed,  it  seemed  that  the  constraints  would  be  so  restrictive 
that  all  of  the  aircraft  could  not  be  modified  in  the  specified  length 
of  the  modification  program.  Therefore,  an  objective  function  was  chosen 
which  would  maximize  the  number  of  aircraft  modified  or  the  number  of 
kits  installed. 

Another  approach  is  to  use  the  application  constraint  to  require  that 
all  the  aircraft  receive  all  of  the  modifications.  in  order  to  have  a 
feasible  solution,  some  of  the  other  constraints  vvill  undoubtedly  have  to 
be  be  relaxed,  and  the  total  length  of  the  program  may  have  to  be  in- 
creased . 

With  all  of  the  aircraft  receiving  all  of  the  modifications,  the  old 
objective  function  is  unusable.  Instead  the  objective  function  can  be 
chosen  to  be  the  total  cost  of  the  program.  Morever,  since  it  is  reason- 
able to  assume  that  the  costs  of  installing  the  kits  is  independent  of 
how  the  aircraft  are  brought  in  for  modification,  the  only  variable  cost; 
in  the  modification  program  are  the  transportation  costs.  Furthermore, 
the  only  variation  in  the  transportation  cost  is  in  the  number  of  trips 
to  the  contractor  facility.  Therefore,  one  possible  objective  function 
is  the  total  transportation  cost  of  the  program,  and  minimizing  the 
transportation  cost  minimizes  the  number  of  trips  to  the  contractor 
facility.  Another  possible  objective  function  is  the  total  out  of 
service  time  while  the  aircraft  are  being  modified.  The  out  of  service 
time  for  a group  of  aircraft  can  be  determined  from  the  subscripts 

j and  k and  from  the  transportation  time  In  fact  the  out  of  servic< 

time  for  the  group  would  be  k+S^-j , An  expression  can  then  be 

obtained  for  the  total  out  of  service  time  for  all  aircraft,  and  the 
program  can  be  carried  out  to  minimize  the  total  of  service  time. 


989 


I I I’ll  : iargi't  Orioiitod  Ciiin  Analysi's  for  I'oas  i t' i 1 i t y Stinlios 

AUTIIOKS:  Ralpli  I'.  Slu'ar  and  UertiMin  H.  C!rollinaii 

IIS  Army  Ballistic  Research  Laboratory 
Aberdeen  Provinji  (Irotiiul,  Mar\  land 


■\B_S  rR.U]_r:  The  objective  of  these  analyses  was  to  examine  and  model  the 
interactive  re  lat  i oieh  i |)s  between  jjiin  and  jirojectile  desijtn  limitations 
and  the  constraints  imposed  by  armored  tarjjet  defeat  by  a Kli  penetrator. 
Ixamination  of  the  interactive  aspects  of  the  problem  resulted  in  the 
need  for  various  relat  ionsliijis  describiiiR  terminal  effects,  flight  tra- 
lectories,  fliijht  projectile  desiRii,  and  those  of  the  interior  ballistics 
of  the  >tun.  The  resultinj;  model,  called  ITXiA,  covers  the  entire  course 
of  tie  ballistic  trajectory  from  the  time  of  firinj;  to  target  defeat. 

Ihe  comfHiter  model  provides  the  user  with  information  concerninj;  K'*''. 
projectile,  and  penetration.  Vhe  user  may  s])ecify  certain  constraints 
on,  for  example,  chamber  volume,  muzzle  velocity,  or  penetrator  diameter, 
and  obtain  sun,  projectile,  and  penetrator  p.ir.imeter  values  which  I'esult 
in  the  jicrforat ion  of  a plate  of  maximum  thickness. 
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r\Ki;i:i  okii^nti  i)  cun  analysis  iok  i-i-.ASiiui.i  iy  studii  s 


Mr.  Kal))h  1:.  Shear  aiul  Mr.  Uertrain  h.  (In)  1 1 man 
US  Ariii)-  liallistie  Ke.seare)i  Lal)()ratory 

I.  INTKOUUCTIDN 

Requirements  for  the  ilefeat  of  ai’iiiored  tarjjets  hy  kinetic  energy 
penet  rati)rs  impose  certain  cvnist  ra  i nt  s on  ^iin  desijtn  clia  ract  er  i sf  i cs  atui 
parameters.  In  an  effort  to  Jetermine  and  quantify  tiu'se  constraints 
imposod  hy  tarjtet  defeat  requ i rtmient s a target  orietUed  unn  analvsis 
program  was  utiilert  akt'n  and  the  resulting  re  I at  ionsh  i ]is  prop.rammed  for 
computi.'!'  analNsis.  Hie  analysis  took  into  account  terminal  ballistic 
relationships,  t'xterior  aiul  interior  hallistics,  thus  covering  the 
entire  course  of  the  ballistic  trajectory  from  the  time  of  firinK  to 
target  defeat.  Ihe  resulting  computer  projtram,  called  TOl'iA,  is  written 
so  that  the  user  may  spec i f >■  the  thickness  of  armor  plate  to  he  defeated, 
the  program  then  calculates  the  trajectory,  subject  to  flijjht  desijtn 
constraints  and  assumptions,  from  the  target  back  to  the  gun  muzzle. 

The  resulting  calculated  inuzrle  'iclocil)’  and  flight  projectile  character- 
istics are  then  uset.1  as  initial  coiulitions  for  the  interior  ballistic 
calculations.  I'UL.A  provides  t iie  user  with  values  of  muzzle  velocilx’, 
peneti-ator  weight,  flight  projectile  and  in-liore  weight,  propellant 
wt-jght,  chamber  volume,  e.xpansion  ratio  and  travel  as  a function  of  the 
input  parameters;  maximum  breech  pressure,  penetrator  1 eitgt  h- 1 o-d  i amet  er 
ratio,  bore  diameter,  lo.uling  ilensity,  range. 

In  adilition,  the  user  need  not  specify  the  thickness  of  armor  to  be 
defeated  but  ma\  elect  to  determine  the  raa.ximum  thickness  of  armor  which 
can  he  defeated  b\'  a kf  penetrator  subject  ti>  constraints  on  the  shot 
travel,  ch.imber  volume,  charge  and  projectile  weight. 

TOCA  h;is  incorporated  within  it  certain  empirical  relationships 
wiiich  have  been  finiiul  to  be  usi'fiil,  i>ver  the  vears,  in  various  gun 
anaU’ses  and  studies.  I'or  example,  I'OCiA  vises  an  empirical  re  lat  uinsh  i p 
which  relates  the  projectile  we i ght - to-cha rge  weight  ratio  to  muzzle 
velocitv’.  Ihe  use  of  such  re  1 at  i ivnsh  ips  has  the  effect  of  resti'icting 
the  set  of  candidate  solutions  to  ;i  set  of  state-of-the-art  solutions. 
I'urtheniMre,  such  empirical  relations  restrict  the  o]it  imi  zat  iiut  procedure 
to  those  methods  which  do  not  require  derivatives.  The  methovi  used  in 
I'tKlA  is  the  so-called  i'omplex  Methoil  due  to  M.  .1.  box  . 

rhe  gun  designer  mav  also  wish  to  have  some  estimates  of  breech 
pressvire,  shot  vehu-ity  and  travel  as  a function  of  time  of  shot  travel. 
In  rOtlA  these  are  obtained  by  a slight  variant  of  the  method  of  l.evluc  \ 


II.  I'RVIBI.IM  |■()R^HII.AT10^ 


Let  0 vlenote  the  vector  whose  component  s liescrihe 
ertiv's  of  the  [leiiv't r.itor , e.g..  ih'iisitv'  c , hardness, 

obliipiity,  h , of  penetrator  tci  target,  etcl'. 


tlve  fi.xed  prop- 
material,  angle  of 


1.0.. 


aiul  lot  1 iloiiuto  tho  pro|)ol  laiK  and  proiiollant  j;as  valiios, 
donsity,  foroo,  spool  t'io  hoar  ratio,  otc., 

• = I- >)  U) 

and  • tho  t'i.xod  proport  los  of  tho  taryjot,  such  as,  donsitv,  rany;o, 

> = U'j  . K.  matorial  , . . . ) [?<) 

lurt hormoro , lot  h donoto  oortain  dosij;n  paramotors  of  intorost, 
namo  1 y , 


B = l./n.  h.  1’^)  (.1) 

whoro  A is  tho  loadini;  donsity  of  tho  propollant,  l./'l),  tlu-  loiu’.th 
to-diamotor  ratio  for  tho  ponotrator,  h,  tho  boro  diamotor  and  I’  tho 
inaxiimim  hroooh  prosstiro.  ^ 

Tho  dopth  of  penetration  of  a given  target  is  given  by  tho 
ro 1 at ionsh i p 


I’  = l’(V,  n;  h;  i;  o;  r)  (S) 

and,  foi"  tho  calculations  described  hero,  tho  form  iluo  to  C.r.iharok  * 

is  assumed,  vi:, 

I’  = f(o;  r;  tO  V'"'  I)''  C(.l 

with  c .and  d greater  than  zero. 

In  tho  following  wo  seek  to  define  the  gun  which  will  ileliver  a 
ponotrator  to  the  given  target,  at  range  K,  with  values  of  V and  b.  such 

that  a t.irget  plate  of  maximum  thickness  will  be  perforated. 

A penetrator  of  diameter  0 striking  a target  with  velocity  V will 
penetrate  the  target  to  a depth  I'  given  by  (S)  or  (d).  The  delivery  of 
the  penetrator  to  the  target  depends  upon  the  flight  characteristics  of 
the  in-flight  projectile  and  its  initial  velocity.  The  initial  velocity 
is  the  unknown  muzzle  velocity  which  is  bounded  liy  V and,  in  turn, 
the  penetrator  and  in-flight  projectile  diameters  are'*'  bouniled  bv  tho 
boro  diameter  b.  I'hus, 

()<!)<  b 


Hence,  when  the  penetration  depth  is  given  by  ((>)  wo  havo 

" I t’  1 >’*  (\ax’ 


()0  2 


where  is  an  upper  bound  to  the  thickness  of  target  which  can  be  per- 
forated by  a penetrator-gun-projecti le  complex  defined  by  fixed  6,  i,  P 
and  e.  We  seek  to  determine  the  maximum  F’  over  some  region  0 < D £ b; 

0 < V < V ard  where  additional  constraints  are  imposed.  Our  problem 

can  be  written  as 

Maximize  P(V,  D;  S;  e;  p;  tJ  (8) 

iV.Di 

subject  to 


(V, 

0; 

B;  t ; 

p; 

T) 

< 

0 

F-, 

(V. 

0; 

B;  e; 

p; 

T) 

< 

0 

* 

• 

f 

(V, 

D; 

B;  e: 

p; 

t) 

< 

0 

The  equations  (9)  represent  functional  relationships  for  the  deter- 
mination of  muzzle  velocity,  flight  projectile  diameter  and  weight  and 
the  interior  ballistic  equations  necessary  to  obtain  charge  weight, 
projectile  weight,  chamber  volume,  expansion  ratio  and  maximum  travel. 
The  vectors  S,  , p and  t remain  fixed  throughout  any  given  calculation. 
In  addition,  equations  f9j  also  include  all  constraints  placed  upon  the 
range  of  values  for  any  of  the  calculated  parameters.  Thus,  in  general, 
P < P*. 


HI.  Till-;  PXTRRIOR  BALLISTIC  CALCULXTION 


In  describing  the  target  penetration  by  a KL  penetrator  the  terminal 
ballistician  uses  such  descriptors  as  penetrator  diameter  0,  striking 
velocity  V,  and  penetrator  length- to-diameter  ratio.  In  order  to  relate 
these  variables  to  the  gun,  that  is,  to  determine  the  launch  velocity, 
or  muzzle  velocity,  we  need  to  define  the  flight  vehicle  and  its  velocity 
loss  from  the  gun  to  the  target.  Thus,  we  make  assumptions  about  the 
design  of  the  flight  vehicle^.  For  example,  the  angle  of  the  nose  cone, 
number  of  fins  and  how  they  are  fitted  and  scaled  according  to  penetrator 
diameter.  With  these  assumptions  we  can  estimate  the  drag  coefficient 
Cp  by  a relationship  of  the  form 

+ a,V  + a.^  + a^  • a ClOj 

where  n is  the  length-to-diameter  ratio  of  the  flight  vehicle. 
Furthermore  we  assume  that  the  velocity-range  relation  can  be  taken  as 


dV  *^o  '’f  ^ 

dR  - 2 Wj,p 


(11) 


where  p is  the 
weight  of  the  flight 


density  of  air, 
projectile.  Thus 


- a shape  factor  and  W^p  is 
integrating  (11)  with  (10), 


the 


993 


backw.n-ils  troni  thi'  turret,  at  ranj^o  K,  to  tlio  Kiiii,  wht're  K = 0,  wo 
obtain  ttu'  mii’ilt'  veliK'ity.  In  aikiition,  we  know  the  weij;ht,  diameter 
aiui  average  density  of  the  flii;l>t  pro i eet  i 1 e . These  values  provide 
initial  values  for  the  interior  ballistic  calculations. 


IV.  INTI-.RIOR  BAl.l.l.STlCS  ('AI.Ctll.A  llONS 


Tor  the  interior  ballistics  calculation  we  seek  to  determine  the 

charjte  weij^ht,  C,  projectile  weijtht,  IVp , travel,  XM,  chamber  volume,  CV, 

and  expansion  ratio,  T.XR,  subject  to  a known  value  of  the  muzzle  velocity 

.ind  constant  R and  i.  liven  with  jjiven  H,  t and  muzzle  velocity  V there 

exists  a multitude  of  possible  solutions  for  the  above  parameters. 

Therefore  we  ni.ike  two  additional  assumptions,  namely,  we  utilize  an 

empirical  re  1 ;it  i onsh  i p , vlevelojied  by  ilrollman,  which  relates  muzzle 

velocity  to  char>te-to-pro  iect  i le-wei  j>ht  ratio.  Thus,  given  muzzle 

velocity  V we  can  fiiul  ('/W,,  from 
' m 1’ 

C/Vv'i,  = - :7:.8)/(  J(v7.7  - 0.9.S.S  . (12) 


The  second  assumption  we  make  is  that  we  have  a sabot  weight  pre- 
dictor from  which,  given  flight  projectile  weight,  the  in-bore  jirojectile 
weight  W can  be  computed.  One  of  the  relationships  used  in  this  stud> 
was  developed  by  B.  Burns*  .itui  is  ;i  fit  of  certain  non-dimensional 
groups  to  existing  saboted  |iro j ec t i 1 es . The  functional  form  of  this 
re  1 ;i  t i onsh  i p is 


- ‘'SP 


|i 


SP 


('/W„ 


n • r 

vs 


(l.Xl 


where  ^ is  the  \ ield  strength  of  the  sabot  material,  p an  average 

density  of  the  flight  vehicle,  and  o the  density  of  the  sabot  material, 
ilther  re  1 at  i onsh  i jis  ma>  be  assumed  and  in  some  crises  we  have  used  a 
state-of-the-art  figure  , such  as 


"sabot '"P 


0.  .'vX 


in  order  to  calculate  the  in-bore  projectile  weight. 

Uith  these  relations  we  obtain  the  charge  weight  f,  from  which^and  the 
loading  density,  we  calculate  the  chamber  volume 

CV  = C/.\  . (l.n 

The  P idiluck- Kent  constant,  f' , is  then  computed  from  the  relationships 
renorted  tiy  lirol  Iman  and  Baer**.  The  Pidduck-Kent  constant  enters  into 
our  calculation  of  the  expansion  ratio  and  the  projectile  travel.  The 
expansion  • itio  is  computed  from  an  inversed  Mayer-llart calculation, 
where  the  velocity,  chamber  volume  and  charge- to-iiroject i 1 e weight  ratio 
is  given.  The  travel,  XM,  is  then  given  by 
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\M  « r\  tl  \R  - 1 ) 


( IS\ 


It  uotu'  ot'  t ho  ahovo  o;»loiil;it  ions  \iol.ito  imiiosod  oonst  taints  ttuni 
this  cv>m)'lotos  t ho  oa  1 on  I at  i on  of'  a foasihlo  point  for  t lu-  opt  imi  :at  u'li 
prohloi.1.  Viihtional  (>oints  aro  i;onoratoil  ami  roiootoJ  as  iIosoi  iIhsI  in 
t ho  al>;v'rithin  of  t iio  Box  t'omplox  mot  hod-' , ' ^ . (.'oust  ra  i nt  s ma\  ho  imposovl 
on  piMiootilo  woiftht  , travol,  ohamhor  volnmo,  imi;;lo  volooitw  ponot  ra 
t ion  woijttu  anvl  ohar^o- 1 o- pro  i oo  t i 1 o v>ointit  ratio,  h’hon  tito  alnno 
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As  .1  p.irt  oi'  oortlin  foas  i !■>  i 1 i t v stiulios  it  is  nooossari  tli.it  so'iu- 
t'stim.ito  of  prossnro,  volooitv  aiul  tr.ivol  ho  provisUsl  as  a fiinot  iv'ii  vif 
time.  In  lOtlA.  tiioso  .iri  provivlov.1  hy  utilizing;  tiio  fojno  motluul*. 
t>rv>  1 1 m.in  * • h.is  rooont  l\  "rov  i s 1 1 ov.1"  tlio  1 oihio  mothoil  aiul  has  t r.iooJ  its 
histori  .iiul  .ii'i'l  io.it  ion  in  a fort  hcoiiiini;  Ballistio  Rosoaroh  l.ahor.itorv 
Report.  I.ovluo  .issnnioil  th.it  tho  volooity  of’  tho  in-hviro  proiootilo 
s.itisfios  tho  rol.it  ion 
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howovi'r,  1*1'  aii'i't  tins  prvililom  hv  iivit  iiu;  tliat  at  in  - 1 the  maximum 
hreech  ('ressure  is  attaiiU'il,  aiul  at  full  tra\el  ue  have  m - • \M'd  ' 
m . I'h  1 s I ut\innat  ion  .‘lli'i*s  us  to  eompute  tiu'  time  elapsei.!  hetween 
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Suht  rae  t i nr.  the  time  elapsed,  t'riim  m 1 tvi  when  m = _’\M  d,  from 

(J.'"').  then,  from  (Jll,  we  ran  ealrulate  the  value  of  m (11  correspond  i n.r 
to  the  remaiiiinr,  time.  \ simple  translation  then  can  he  used  to  del'ine 
t o at  this  value  ol'  m.  Thus  from  i 1 " 1 . Idl)  and  the  definition  of  m 
we  can  read  i 1 1 obtain  pressure,  \elocit\  and  tr.ivel  as  .i  function  of 
time  Ihe  const  ints  .i  ,nid  d are  determinovl  t'rom  (lul,  l.^('l  since  we  know 
till'  mu.';le  velociti,  tot.il  travel  .nul  m.ixiiniiin  hreech  pressure. 

\ I . I \ AMI'I  I S 

lor  r"!'"  \alues  of  inaMimim  hreecli  pressure,  lo.Klin.r  densiti,  bore 
.liameti'r  and  penetr.itor  length  to-diameter  ratio,  the  mavimum  tirr.et 
thickness  which  can  be  penetrated,  subject  to  constraints  v'n  ti'tal 
tr  nel  ,ind  charr.e- t o-mass  r.itio,  has  been  cominitcd.  Ihe  output  in  this 
case  iieKis,  in  addition  to  m.iximum  t.irr,et  plate  thickness  |iorforated, 
values  of  traiel,  ch.irr.e  weirht.  cha  r.re- 1 o-pro  i ec  t 1 1 e- we  i r.ht  ritio,  in- 
bore  proiectile  wei.rlit,  chamber  volume,  flir.lit  ]iroiectile  wei.rl't  and 
diameter,  penetr.itor  diameter,  sfrikinr,  velocitv,  exi'ansion  ratio  and 
mu.''.le  vi'locitv.  Ihe  variation  <>f  e.ich  p.irameler  mav  bt'  examined  in 
relatiiin  to  cii.inc.es  m the  cv'mpv'tieiit  s vif  , but  here,  we  shall  be  cv'n- 
tenti'vl  with  demonstrating,  the  v.iriation  of  I'  with  rv'spect  to  ! /I'  and  one 
other  ci'minment  of  . . None  v'f  the  jiresented  calciilatunis  are  relateil  to 
exist  me.  known  e.uns  and,  for  each,  the  penetrator  is  depleted  uranium 
with  splverical  lU'se  and  sub- caliber  e.rvH'ves. 
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Ill  t ijiurt'  1 the  maxinuun  thickness  of  target  jilate  perforated, 
hereafter  called  maximum  [lenet  rat  i on , is  plotted  versus  jieneti-ator  1 ,'l> 
for  various  bore  diameters. 

In  fi>;ure  J,  maximum  penetration  depth  is  plotted  versus  l./D,  for 
various  values  of  total  travel,  for  a ^.Smm  bore  diameter  jiun. 

In  fi.cure  ?>,  the  effect  of  rnaximiijn  breech  pressure  on  maximum  pene- 
tration versus  l./n  is  shown  for  a ''5mm  j;tiii  with  "tube  lenj^th"  or  travel 
constrained  to  be  1()8".  Similarly  in  fijiure  -1  the  effect  of  loading 
density  on  I’  versus  l./P  is  shown  for  a ’0mm  Kiin.  finally,  in  fijjure  5, 
the  results  from  the  I.educ  calculations  are  shown  for  ''Smm  bore  nun  with 
total  travel  confined  to  oO  times  the  bore  diameter.  The  plot  shows 
pressure,  sc.iled  by  maximum  breech  jiressure,  scaled  velocity  and  scaled 
travel  as  .i  function  of  scaled  time. 


997 


K1  I t K1  Ni  l ^ 


K.  i.ri'llm.m  .iiiil  s . 1 rut  , "I’lr  uv  t rJ  I'.iv'wth  l\'triiti.il  t\'i'  Si>\  u-t 
•iiul  Mhiim  I .i:ni  1 \ rt  \iumuiu  t u>ii"  Uilli->tiv''  Ri-sra  i\li  I .iImim  t r i' irs 
Mrmrv.viulum  Koport  , I'Rl  M 

'I  . Iv'v.  1 lu-  I'ampiit  iT  .K'uiii.il,  S.  IJ  il'it'M 

Thai)  rat.  Kr\  a'\rt..  \ol.  1 \\  . pp  ISl  I Sc  il'tp.t) 

v'  (..fal'a  If  k . "I'rnr  t fa  t i rii  vit  Vniu'f  In  sti-rl  aiul  Hip.h  l'riisit\  I’riu' 

tfatof-;",  Rail  1st  ir  Krsrairli  I al'rr  at  or  i rs  Mrmv'iaiulmM  Krpi'it  , RKl.M- 
:i>l  il'i'M 

1.  RfaiKli'M,  laiitu'h  ti  llij;t\t  I'nision,  HKI  . I’fuatr  rv’inmuiu  r a t i on . 

R.  Ruriis.  IKWKMH'OM  RKI  , private  vi'inmiiii  i r at  u'li . 

V . cril'arrk,  (IS  \ \R \lUk"1  RKl  , prn.itr  r I'mimiiit  r a t i rn  . 

R.  cfi’llmaM  I'.  Rarr.  "l'r\ i- Iv'pmrnt  »'!'  a I'nlJuik  knit  I'uiutiou  tor 
uim  Intrrirr  Rallistirs  lomp';  • a t ion"  Rallistir  Krsrarrh  1 al'v'rat  or  i r s 
Krj'oi  t . RKIR  l -ia  ;10'P) 

a.  1.  'Iivrr,  "s  i mp  1 1 1 i ovl  Kjuations  ot'  Intrrior  Rallistirs", 

Rail  1st  tr  Krsrarrh  1 ah.'rat  v'r  i rs  Krport  . RKl  K vSS  il'>l>) 

h.  I Mavrr  R.  \.  Mart,  ,1.  liaiikliti  Inst.  .'Ki.  liM  iioifo 

i'-  S,  i;.  RrvrriJro  -i  K.  S.  srlirrhtrr.  Opt  iini  .‘at  uni  : Ihroin  ainl 
I'l  art  irr  . Mri'.raw  II  i 1 1 . \ . 1 . . I '>  '0 

rt  . Rakrr  .1'  1 rank  , r t a 1 

"i.iin  Viimiin  1 1 ion  iRniinu'iia  1 1 1 \ StmU",  \v'l  11,  Rallistir  Krsr.irrh 
1 al'v't  ator  irs  Krp>'rt  RKl  K lS:o)  il'l'tO 

R.  orv'llman,  "Irvliir  Krvisitrvl",  IN  \ \K  MHO'I  RKl  Ki'port  i t'orthromink;) 


MAX  PENETRATION 


MAX  PENETRATION  (mm) 


MAX  PENETRATION  (mm) 


T/  THAT 


ABSTRACT 


TITLt:  A Review  of  Data  Estimates  and  Subjective  Probability 
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ABSTRACT: 


This  paper  addresses  subjective  probabilities  and  estimates  of 
uncertain  events  in  the  future.  The  discussion  is  concerned  with 
estimator's  ability  to  provide  estimates.  Tversky  and  Kahneman  have 
found  that  three  heuristics  describe  the  factors  which  determine  an 
individual's  estimate.  The  basic  conclusion  one  can  reach  is  that 
individual  or  group  subjective  estimates  are  still  a measure  of  belief. 
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1.  INTRODUCTION 

This  paper  addresses  an  aspect  of  decision  making  where  subjective 
estimates  are  required  on  uncertain  future  events.  The  need  for 
estimates  arises  when  a problem  has  been  recognized  by  the  decision 
maker  and  the  alternatives  that  are  considered  feasible  must  be  evaluated. 
To  evaluate  the  problem  or  venture  under  consideration  requires  either 
point  estimates  or  probability  distributions  of  possible  outcomes. 

The  predicting  of  outcomes  of  future  events  is  not  limited  to  decision 
making  alone.  Predicting  hardware  reliability,  marketing  income,  or 
political  elections  can  require  estimates  of  future  outcomes. 

Typically,  the  situation  in  industrial  or  governmental  decision 
making,  where  the  possible  outcomes  of  a venture  are  required,  is  when  a 
decision  is  to  be  made  whether  to  proceed  or  chose  another  venture. 

Rather  than  one  venture  this  analysis  may  involve  a series  of  ventures 
and  alternatives.  An  example  of  a major  venture  would  be  the  establishment 
of  a new  manufacturing  plant.  The  outcome  of  an  activity  will  only  be 
known  with  certainty  after  the  event  has  occurred.  Thus,  a problem 
facing  one  is  making  sound  and  reasonable  subjective  estimates  of  these 
outcomes. 

If  one  had  an  activity  that  was  inexpensive  and  repetitious,  then 
an  experiment  could  be  conducted  that  ran  a number  of  sample  activities 
and  determined  a distribution  of  possible  outcomes.  However,  in  cases 
where  a venture  will  only  be  performed  once,  then  the  distribution  of 
possible  outcomes  must  be  determined  subjectively.  In  obtaining  these 
subjective  estimates  from  experts  most  techniques  try  to  ensure  that 
each  expert  considers  all  known  factors  on  the  activity  and  gives  an 
unbiased  estimate. 

2.  DISCUSSION 

2.1  Subjective  Probability.  To  consider  data  estimates  some 
discussion  is  required  of  subjective  probabilities.  In  reviewing 
the  variety  of  articles  in  the  literature  concerning  subjective 
probability  estimates,  some  definitions  are  required  of  probability. 

Savage  gives  three  classes  of  interpretation  of  probability  [10]. 


a.  Objective  probability  is  derived  from  a repetitive  event 
that  agrees  reasonably  close  with  the  mathematical  concept  of 
probability  for  such  <in  independently  repeated  random  event. 

b.  A personal istic  or  subjective  probability  is  a measure 
of  confidence  an  individual  has  in  truth  of  a particular  proposition 
or  event. 


c.  A necessary  probability  is  measure  of  the  extent  one  set 
of  propositions,  out  of  logical  necessity  and  independent  from  opinion, 
confirms  the  truth  of  another. 

A more  classical  definition  of  objective  probability  can  be 
obtained  from  any  text  on  probability,  such  as: 

The  probability  of  an  event  occurring  is  equal  to  the  ratio 
between  the  number  of  successful  outcomes,  s,  of  the  event  to  the  total 
number  of  outcomes,  n,  that  is 

P IE}  = lim  5 
n — ► " 

A mathematical  definition  of  probability  is  based  on  three  conditions 
for  a real  valued  set  function  P and  a sample  space  A*  satisfying, 

a.  P(A)  > 0 for  any  event  A c A*  for  which  P(A)  is  defined. 

b.  P(A^  U A^  U A^  ...)  = P(A^)  + PIA^)  + P(A3)  + ... 

whenever  A.| , A^,  A^,  ...  are  mutually  exclusive  events 

(i.e.,  A.  n A.  = 0,  for  all  i ^ j) 

* V 

c.  P(A*)  = 1 

A quite  lengthy  philosophical  discussion  of  probability  as  a measure 
of  belief  is  given  by  Venn.  Probability  can  be  defined  as  either  objective 
or  subjective,  because  it  is  in  the  long  run  of  a series  of  events  that 
the  probability  is  objective  rather  than  subjective.  For  example,  in  the 
toss  of  a fair  coin  the  results  of  a small  number  of  thosses,  say  ten,  do 
not  confirm  the  long  run  expectation.  The  result  of  these  ten  tosses  is 
a measure  of  belief  of  the  long  run  expectation.  (This  example  is  normally 
considered  objective  rather  than  subjective.)  As  the  number  of  tosses 
increase  the  more  this  measure  of  belief  would  begin  to  agree  with  the 
mathematical  expectation  for  this  event.  Thus,  when  the  relative  frequency 
is  sufficiently  large  one  has  an  objective  probability  [13]. 

There  are  two  strong  philosophical  views  of  probability;  they  are 
objective  verses  subjective.  In  most  situation  involving  uncertainty, 
any  estimate  or  judgment  of  outcon^e  will  be  subjective.  Therefore, 
Bayesian,  statistical  procedures  are  normally  used  [.’]. 
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Bayesian  niethods  are  based  on  the  work  of  the  Kevet'end  Thomas  Bayes 
which  was  published  posthumously  in  1763.  The  problem  considered  by  I'.tyrs 
was  drawing  con».1usions  about  the  binomial  parameter  based  on  the  result 
of  X successes  in  n Bernoulli  trials.  The  parameter  p is  itself  considered 
a random  variable  that  has  been  chosen  by  a prior  random  process  such 
that  the  probability  that  p is  in  some  range  between  zero  and  one  is  given 
by  dp.  The  joint  probability  of  obtaining  a value  of  p and  observing  x 
successes  in  n trials  is  given  by  the  product 

("|P"(1-P)  "’"dp 


I 

I 

I 


and  the  probability  distribution  of  p*  the  sample  results,  is 


f(p;  x) 


(’-W Jr 

■1  . X,  , 1 n-x  . 

^ P U-p)  Jp 


The  ivsults  of  Bayes  have  been  taken  by  a number  of  eminent 
mathematicians  and  developed  further  13). 


In  applications  of  Bayes'  Theorem,  the  following  is  used; 
P(A/B)  - P(A) 


where  P(A)  is  the  probability  of  A occurring. 

P(Bl  is  the  probability  of  B occurring. 

P{B,A)  is  the  probability  of  B given  that  A has  occurred. 
r(A/B)  is  the  probability  of  A given  that  B has  occurivd. 

The  ratio  P(B/A)  / P(B)  gives  what  is  known  as  the  measure  of 
relevance.  If  the  ratio  is  one,  the  event  B is  independent  of  A.  In 
using  this  theorem  Lasterling  gives  two  examples  which  show  where  the 
controversy  arises  in  Bayesian  and  classical  statistics.  In  the  first 
example  of  acceptance  sampling  from  seguentially  produced  lots.  Bayesian's 
updating  of  the  prior  knowledge  with  the  new  data  is  guite  acceptable. 

The  classical  statistician  would  use  this  new  data  to  make  inferences 
concerning  the  distribution  parameter  where  is  from  an  assumed 
distribution  f (g).  In  the  other  example  the  parawter  g is  considered 
an  unknown  constant  and  f (g)  is  our  belief  about  what  its  value  might 
be.  This  second  example  incorporates  our  personal  (or  subjective) 
probability  into  any  statistical  inferences  and  thus  raises  the  contro- 
versy. However,  it  should  be  noted  that  any  probability  can  be  consideivd 
subjective  since  one  must  assume  some  distribution  to  nKidel  against  the 
data  (31. 
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In  the  decision  making  process  one  does  not  have  the  lu\ur>  of 
conducting  experiments  on  what  these  possible  outcomes  can  be  and 
thereby  have  data  upon  which  to  build  a probability  distribution.  The 
decision  problem  is  similar  to  estimating  the  result  of  a single  evperinx'nt. 
In  decision  making  one  is  usually  evaluating  alternatives  in  which 
outcomes  are  at  best  uncertain.  The  degree  ot  uncertainty  in  an  outcome 
is  usually  expressed  as  some  probability  estinwte.  This  value  is  based 
on  an  individual  (hopefully  more  than  one  individual  is  gueriedl  estinwte 
and  is  subjective.  However,  this  tact  does  not  prevent  one  from  usinu 
classical  statistical  method,  but  only  remt'inber  that  all  results  are 
based  on  this  subjective  estinuite. 

J.J  biases  in  Istimating  Subjective  Probabilities.  In  a situation 
where  outcomes  are  uncertain,  estimates  of  outcomes  are  solicited  from 
those  individuals  who  are  cognuant  of  the  factors  which  influence  these 
outcomes.  Kecent  studies  have  been  conducted  to  determine  the  tyt'o  and 
extent  biases  entered  into  subjective  estimates.  The  majority  of  the 
material  in  this  section  on  methods  by  which  individuals  arrive  at  an 
estimate  is  based  on  an  article  by  Iversky  and  kahneman  | 1 I . 

Lven  though  these  individuals  are  experts,  this  does  not  keep  them 
from  having  biases  and  feelings  about  the  areas  in  which  they  are  guest loned. 
In  recent  studies  using  experts  and  then  native  subjects,  botli  groups 
were  found  to  use  the  sanv  type  of  heuristics  in  their  predictions. 

There  are  three  heuristics  used  in  determining  probabilities  and 
predicting  values; 

a.  Kepresentat  iveiiess 

b.  Availability 

c.  Adjustment  and  Anchoring 

Within  each  of  these  heuristics,  biases  exist  which  nxidify  one's 
judgement  in  predicting  and  assessing. 

The  representativeness  heuristic  mav  ‘ defined  as  a method  by 
which  an  individual  in  answering  a guest  , "What  is  the  probability  A 
came  from  a process  P?"  judges  how  well  w resembles  P.  ■'’H''  an  induidi;al 
is  not  using  data  about  A,  but  a comparison  of  A to  P.  With  training  m 
estimating,  both  the  expert  and  novice  can  reduce  the  errors  inherent  in 
this  heuristic  and  the  other  heuristic  discussed  later. 

A number  of  factors  have  been  found  within  the  representativeness 
heuristic  which  affect  judgements. 

a.  Insensitivity  to  prior  probability  of  outcorx's. 

b.  Insensitivity  to  sample  sice. 

c.  Misconceptions  of  chance. 


d.  Insensitivity  to  predictability. 

e.  The  illusion  of  validity. 

t.  Misconceptions  of  reiiression. 

In  considering  a question  on  A coining  from  B,  the  si;e  or  population 
A represents  should  enter  into  one's  judgements.  If  prior  information 
is  available  this  data  should  be  weighted  by  the  estinutor.  In  experiments 
where  the  subjects  were  told  the  make  up  ot  the  underlying  populations 
(30  percent  A),  the  probability  estimates  were  still  based  on  the  degree 
A represented  G (estimated  bO  percent).  This  effect  is  quite  pronounced 
in  that  worthless  information  about  A was  used  rather  than  disregarding 
it.  When  no  information  on  A was  given,  the  basic  data  on  the  overall 
population  was  used. 

The  size  of  the  sample  as  opposed  to  the  population  size  is  ignorea 
in  assessing  probabilities.  As  the  size  of  the  sample  increases,  the 
closer  the  sample  statistics  will  approach  the  ooimlatUMi  values.  In 
tests  on  various  individuals  the  same  estimates  were  given  for  all 
sample  sizes. 

The  misconception  of  change  is  a significant  problem  in  that  even 
trained  individuals  in  probability  and  statistics  suffered  from  this 
factor.  It  has  been  found  that  people  believe  that  a sequence  of  events 
generated  at  random  will  exhibit  the  same  characteristics  regardless  of 
length.  lor  example,  in  the  tosses  of  a fair  coin,  H-T-T-H-t-H  is 
considered  more  likely  than  -H-u-H-H-q.  Also,  this  belief  leads  to  the 
gambler's  fallacy.  Consider  a roulette  wheel,  after  a long  series  of 
red  most  people  would  expect  a black  is  now  due  because  this  will  give  a 
more  representative  sequence.  However,  these  are  independent  events, 
thus  red  or  black  is  equally  likely  each  turn  of  the  wheel.  A related 
problem  is  that  in  believing  small  samples  should  represent  the  long 
term  expectation,  researches  were  found  to  put  too  much  faith  in  small 
samples  and  to  extrapolate  too  much. 

Insensitivity  to  predictability  is  when  the  data  concerning  an 
outcome  is  used  based  on  how  good  the  information  depicts  the  outcome. 

If  the  description  of  outcome  A is  very  good,  then  the  probability  given 
A is  high;  if  it  is  poor,  then  the  probability  assigned  is  low. 

The  illusion  of  validity  is  another  strong  factor  in  people.  An 
individual  will  estimate  an  outcome  based  on  how  well  that  represents 
the  input  with  minimum  consideration  for  those  items  which  limit  predictive 
accuracy.  Highly  consistent  patterns  in  the  input  data  give  individuals 
more  confidence  in  their  prediction.  Two  distributions  can  have  the 
same  mean  even  if  one  distribution  has  twice  the  range  of  the  other,  but 
an  individual's  confidence  will  be  greater  with  the  distribution  which 
is  more  consistent. 

The  misconception  of  I'egression  is  also  vei'y  common  in  that  most 
processes  tend  to  the  mean  of  the  process  rather  than  to  the  extremes. 

In  most  cases  one  should  expect  a value  near  the  average  rather  than  the 
extremes. 


Ttu'  heuristic  of  ovuilohility  is  one  in  which  an  estimator  will 
assess  the  prohabiUty  of  an  event  by  the  ease  of  which  he  can  recall 
instances  of  the  event.  The  more  comnon  an  event  is  to  an  irulividual, 
the  easier  by  which  he  can  recall  it,  thus  will  associate  a high  pro- 
bability to  ttiat  t'vent  . The  converse  is  also  true. 

a.  Biases  due  to  the  retrievabi 1 ity  of  instances 

b.  Biases  due  to  the  effectiveness  of  a search  set 

c.  Biases  of  imaejinabi  1 ity 

d.  Illusory  correlation 

■^he  ease  at  which  one  can  recall  instances  of  an  event  influences 
an  estimator's  judgement  of  event  frequence.  In  an  experiment  using  lists 
of  famous  people's  names,  subjects  in  one  group  were  given  a list  on  which 
the  men  were  more  famous  than  the  women  and  the  other  group,  tlie  subjects 
were  given  a list  on  which  the  women  were  more  famous.  The  subjects 
judged  the  list  containing  famous  men  as  having  more  men  than  women  on  it 
when  it  did  not,  and  the  converse  for  the  other  group  having  the  list 
containing  famous  women.  In  addition,  if  an  event  has  recently  occurred 
to  the  estimator,  than  it  is  easier  to  recall  similar  events,  thus  giving 
a higher  probability  to  the  frequency  of  occurrence. 

The  ease  at  which  one  can  mentally  search  for  like  events  will  also 
affect  the  probability  estimate.  If  in  asking  which  of  two  events  can 
occur  most  often,  such  as  the  occurrence  of  r as  the  first  letter  or  the 
third  letter  of  a word.  It  is  easier  to  think  of  words  beginning  with 
r than  in  the  third  position.  The  result  of  the  experiment  is  that 
subjects  estimate  it  is  the  first  most  often  when  in  fact  the  third 
position  is  correct. 

Some  questions  asked  of  an  estimator  depend  on  his  ability  to 
imagine  the  events  occurring.  The  estimating  of  sequences,  mathematical 
relationship,  and  infrequent  events  requi''es  an  individual  to  mentally 
generate  a series  of  events  according  to  some  rule.  Usually  population 
characteristics,  such  as  a bell-shaped  distribution,  are  not  associated 
with  oeneratinq  these  sequences. 

Finally  the  illusory  correlation  biases  entered  into  one's  judgement 
when  trying  to  estimate  the  frequence  of  two  events  co-occurring. 

Subjects  were  found  to  overestimate  the  frequence  of  co-occurrence  of 
associated  events.  The  degree  of  association  seemed  to  be  the  cause  of 
this  effect. 

The  last  heuristic  that  was  reported  was  adjustment  and  anchoring. 
This  effect  would  occur  most  often  in  conducting  surveys.  The  initial 
value  given  is  usally  taken  by  the  estimator  as  a reference  point  for 
all  other  predictions.  The  divergence  from  this  point  is  usually  not 
sufficient  to  cover  the  range  of  values.  This  effect  also  occurs  if 
incomplete  data  or  calculations  are  used.  The  biases  that  were  four 
are  given  below; 
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a.  Insufficient  adjustment. 

b.  Biases  in  the  evaluation  of  conjunctive  and  disjunctive 

events . 

c.  Anchoring  in  the  assessment  of  subjective  probability 
distributions . 

Insufficient  adjustment  from  the  initial  point  can  be  seen  in  an 
example  of  computations.  For  example  8x7x6x5x4x3x2xl  and  1 x2x3x4x5x6x7x8. 
These  two  sequences  were  presented  to  two  different  groups.  Group  one 
was  asked  to  estimate  the  value  of  the  first  product  within  five  seconds, 
the  second  group  the  second  sequence.  The  first  group  estimated  using 
the  computations  from  the  high  end  and  had  a higher  estimate  of  the 
total  product  of  81  than  the  second  group.  Neither  group  recognized 
that  these  sequences  were  eight  factorial. 

The  biases  in  conjunctive  and  disjunctive  events  occur  because  of 
the  inability  to  relate  the  serial  and  parallel  effect  of  events.  In 
reliability  the  probability  of  success  in  a series  is  less  than  the 
lease  reliable,  and  in  a parallel  configuration  the  probability  of  success 
is  higher  than  any  single  item.  In  estimating  this  bias  causes  an 
overestimation  for  conjunctive  events  and  an  underestimation  for  disjunctive 
events. 

In  assessing  probability  distribution,  the  manner  in  which  the 
questioning  begins  will  determine  the  distribution  given.  If  questioning 
begins  with  estimating  the  mid  point  (50  percent  point),  a more  accurate 
distribution  is  obtained  than  when  questioning  begins  at  the  extremes. 
Beginning  at  the  extremes  results  in  too  tight  a distribution. 

In  a study  performed  by  Hahn,  different  biases  entered  into  his 
results  [41.  A questionnaire  on  an  intended  symposium  and  the  respondent's 
probability  of  attendance  were  compared  with  the  actual  attendance.  There 
was  a significant  difference;  of  the  436  respondents  who  indicated  yes, 
only  82  individuals  actually  attended.  The  dicision  was  made  to  have  the 
symposium  and  463  people  attended,  but  the  data  collected  was  wrong.  The 
type  biases  that  showed  up  when  the  nonattendees  were  interviewed  were 
varied  and  different  from  those  cited  by  Tversky  and  Kahneman. 

These  respondents  were  in  an  actual  industrial  environment  which 
caused  them  to  weigh  their  responses  in  light  of  management  and  benefits 
to  themselves.  Many  individuals  believed  that  the  symposium  was  a good 
idea  and  should  be  held.  Therefore,  they  answered  that  they  would  attend 
when  they  knew  that  they  would  not.  Also  the  questionnaire  did  not  give 
any  incentive  to  provide  good  estimates. 

In  high  incentive  situations  good  estimates  are  usually  obtained. 
Analyzing  the  results  of  horse  race  data  collected  from  Aqueduct  and 
Belmont  Park  in  1970  Hoerl  and  Fallin  show  for  the  statistic  at  the 
0.94  confidence  level  that  the  subjective  probabilities  are  accepted  as 
the  correct  theoretical  frequencies  of  wins  [5).  Thus,  it  is  concluded 
that  the  group  consensus  can  evaluate  an  actual  situation  and  provide 
reliable  subjective  probabilities. 


?.3  Cwiibininq  Subjective  Probabilities.  Fven  with  all  the  inherent 
defects  of  estimating  by  individuals  or  groups,  the  use  of  experts  for 
predicting  future  uncertain  events  is  currently  the  only  method  used  for 
one  time  events.  The  standard  practice,  it  seems,  is  to  obtain  more  than 
one  expert's  estimate  or  opinion  and  fonn  a consensus.  The  most  common 
method  of  obtaining  a consensus  is  to  use  the  mean: 


= : t.  N 


where  n is  the  number  of  experts  and  x-  is  the  i- 
estimate. 

In  the  case  of  a "yes"  or  "no"  answer  then 


expert ' s 


= - z 

L"  i=i 


where  x = 0 or  1 

This  formula  is  the  solution  of  the  simple  majority  vote  [1|. 

In  some  practical  situations  the  question  arises  as  to  the  expert's 
competency.  In  these  cases  (1)  and  (2)  can  be  modified  by  including  a 
ranking  c-,  of  each  expert's  estimate: 


) c . X . 
i = l ’ ’ 

E c.  X.  + i 


where 


c . =1 , and  c . 2 0,  i=l . . . .n 


However,  in  using  a ranking  system  more  problems  can  arise  because 
of  who  is  establishing  the  ranking.  If  the  experts  rank  each  other  then 
the  c^-  can  be  established  by  using  a modification  of  (3). 


'i?,  ■'  

where  a^j  is  the  weight  expert  j assigns  to  expert  i 

The  numbers  a^j  must  satisfy 

i - 0,i , j = 1 n 

'J  n 

and  I]  a . . = 1 , j = 1 n 

i = l 
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However,  this  system  of  equations  is  linearly  dependent  and  its 
determinant  is  zero.  To  solve  this  problem  requires  the  use  of 
decomposition  of  a matrix.  The  matrix  is  decomposable  to  the  fonn 

A,  0 
B 

Using  this  fact  allows  one  to  find  a unique  solution  for  the  c^. 's. 
For  a complete  discussion  the  reader  is  referred  to  [ll.  A simple 
solution  is  reconriended  so  that  the  determinant  is  nonzero.  The  expert 
does  not  rank  himself,  that  is  a • .j  = 0.  The  researcher  rates  each 
expert  and  then  normalizes  the  riw: 


a* 


i j 


‘*ij  , where  a-,  is  assigned  by  the  researcher, 
n 


In  those  cases  where  a probability  distribution  is  obtained  from 
each  expert  then  the  technique  of  convolutinq  the  distributions  can  be 
used.  Assuminq  that  the  probability  distribution  or  probability  density 
functions  (pdf)  are  independent  then  a joint  pdf  can  be  defined  as: 

f (x^,  Xp,  X3,  ) = f^(x^).f2  ^*^3^ 

In  convolution  one  desires  the  random  variable  s,  defined  by 


s = x.|  + x^  + Xj  + . . . 

For  the  continuous  case  the  pdf  of  s is  found  by  repeated  application 
of  first  findina  the  pdf  of  s^  = x,  + x„,  then  s.,  = So  + x,  and  so  on. 

The  pdf  of  s^  is  determined  by: 

q(s)  =1  f^  (x^)  f^  (s-x^)  dx^ 

The  end  result  will  be  a consensus  pdf  for  all  experts  111]. 

2.4  Cognitive  Psychology  of  M^n.  The  psychologist  view  of  man  is 
from  a different  prospectus  and  is  described  by  Hogarth  t6l . Cognitive 
psychology  is  an  area  that  considers  the  study  of  perception,  problem 
solving,  judgemental  processes,  thinking,  concept  formulation,  and  human 
information  processing  in  general.  In  these  various  subgroups,  the 
psychologist  is  searching  for  how  man  performs  these  activities  and  what 
are  his  limitations. 

Two  basic  premises  have  been  arrived  at  - one  that  man  has  only  a 
limited  information  processing  capacity;  yet,  the  other  is  that  he  is 
an  adaptive  creature.  He  can  determine  a number  of  possible  strategies 
when  dealing  with  a complex  task  with  his  limited  processing  capability. 


This  limited  comprehension  capability  can  be  seen  in  experiments  using 
numbers.  Using  a string  of  digits,  the  average  person  can  recall  only 
about  seven  digits.  A few  people  can  recall  ten  digits.  When  faced 
with  a complex  problem  of  assessing  many  factors,  it  is  a difficult  task 
for  man.  But  his  adaptive  capabilities  enable  him  to  handle  these  complex 
problems  as  a series  of  subproblems  by  using  artificial  aids,  such  as 
computers  or  pencil  and  paper,  and  to  assimilate  the  various  factors 
and  reach  a conclusion. 

Psychologists  have  found  in  situations  of  uncertainty  that  most 
people  will  avoid  the  situation  either  by  ignoring  or  rationalizing 
around  the  uncertainty.  This  shortcoming  is  carried  over  into  assessing 
probabilities  in  that  one  is  required  to  make  estimates  on  an  uncertain 
event  and  his  natural  instinct  is  to  avoid  such  a situation. 

When  faced  with  uncertain  events,  man  tends  to  organize  the  unknown 
factors  associated  with  this  event  into  groupings  or  categories.  Grouping 
or  categorizing  is  seen  in  most  all  pursuits  and  is  characterized  by 
using  such  things  as  symmetry,  closure,  proximity,  and  similarity. 

However,  this  organizing  causes  man  to  look  for  patterns  in  events  when 
they  are  not  there.  It  has  been  found  that  man  can  detect  slight  changes 
in  dynamic  processes  much  better  than  in  a stationary  process.  The 
conjecture  of  why  this  is  probable  is  that  man  is  an  adaptive  creature 
that  has  been  forced  to  learn  to  live  in  a dynamic  world.  This  conjecture 
can  also  be  seen  in  one's  ability  to  predict  outcomes  of  a series  of 
events  more  accurately  than  a single  event. 

Psychologists  have  found  that  the  customs  of  the  western  society  do 
not  encourage  one  to  develop  a degree  of  precision  in  judging  uncertainty. 
Within  this  society,  custom  dictates  that  one  is  sure  of  oneself,  and  to 
state  any  decision  as  certain.  Thus  one  pretends  to  be  totally  sure  of 
an  outcome  rather  than  expressing  one's  belief  in  an  outcome.  If  required 
to  make  probability  estimates  on  an  uncertain  event,  society  confined 
the  individual's  ability  to  provide  good  estimates.  In  laboratory 
studies,  it  has  been  found  that  most  subject's  probability  thinking  is 
conservative  for  the  most  part. 

Another  psychological  consideration  is  the  meaningfulness  of  the 
task  to  the  estimator.  For  the  task  to  be  meaningful  to  the  individual 
it  should  concern  a subject  with  which  he  is  knowledgeable.  The  time 
frame  for  which  the  estimate  is  made  has  a significant  effect  on  the 
prediction  accuracy.  Most  long  range  forecasts  have  been  found  to  be 
inaccurate.  Lastly,  it  has  been  found  that  a sequential  process  of 
questioning  normally  yields  a more  accurate  estimate  such  as  the  Delphi 
technique. 

The  recommendations  that  cognitive  psychologists  propose  for  improving 
estimator's  abilities  is  to  explore  tne  strategies  and  simplify  methods 
that  are  used  and  to  build  from  this  point.  Basically,  the  question  is 
"how"  people  evaluate  uncertainties  rather  than  "how  well."  Experimental 
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rt'sults  ci'tifii'in  ttuit  tr.iiiiinii  pi-iHiiMins  in\i'r('vt'  tiu'  I'St  iiiiati'S  wtu't(  t(u‘ 
('stiinafors  h.wt'  t't'i'n  ijivt'ii  not  only  tho  cotifopts  of  I'fotiah i 1 i f y .ifut 
statist  ii'i  Init  also  assossmont  tochniquos.  For  most  I'oople  prohahility 
thifikirni  is  a flow  wav  of  thifikinp. 

I.  lONClUSlONS 

In  tho  (locision  makiiui  (U'ocoss  any  ostimato  of  possible  outcomes  is 
baseil  upon  an  i nil  i v iUua  1 ' s Juilqoment.  Thus  any  prohahility  estimate  is 
a iltHiret'  ot  tn'lit't  an  iiulividual  has  in  tht'  t'vent  in  nut'stion.  Ihoro 
art'  two  basic  sctuiols  of  thought  in  t'rohati i 1 i ty  - the  ilassical  or 
I'hjt'ctivt'  school  and  the  suhjettivt'  or  hayesian  school.  Since  there  are 
fundami'iital  diftort'iices  ot  ('tiilosophy  between  thost*  two  (iroups , there 
will  always  t'sist  soiiit'  il i saipi'ement  on  technii|ues. 

In  rt'vit'wiiui  the  literaturf',  a nuiiitn'r  of  diftt'rt'iit  irn'tliod-.  are 
proi'ost'd  on  sol  it  it  inn  these  estimates.  One  technit)ue  that  has  come 
into  a dt'uret'  of  (iromi lu'nci'  is  the  Oelphi  techni(|ue.  Ilowevt'r  a rect'iit 
report  by  Sachiiian  with  the  Kami  t'orporation  was  very  critical  of  the 
Oi'li'lii  techniipie.  One  of  his  basic  roiu  lusions  was  the  IH'lptii  was  an 
unscientitu  and  unverified  method  in  theory  and  practice.  ^ number  of 
statistical  prot'lems  t'sist  because  of  the  maniit'r  in  whiih  data  is  solicitt'd. 
The  iterative  ('rov'i’ss  in  Oelphi  destroys  tIu'  independenct'  in  the  probability 
ilistribiit  ions.  Thus  (onvolution  could  not  be  used  as  st.ited  earlier 
tor  dove  lop  inn  a consensus  distribution  1*^0. 

The  ovt'rall  I'onclusions  one  reai  ties  from  reviewinn  the  liter.iture 
is  that  subjective  probabilities,  or  estimates,  art'  a iiit'ans  of  obtaininn 
knowl-'dtp'  on  an  unct'rtain  I'Vt'iit  tor  which  minimum  intormation  is  kiu'wn. 

Ihere  will  always  be  a ph  i losoi'h  i ca  I dt'batt'  over  the  noodness  of  any 
t'stiamtt's  madt*  ami  it  is  not  e\[iected  that  the  t|ut'stion  will  t'vt'r  bt' 
resoivt'd.  7.  0.  14). 

Ituninh  man  has  a limited  information  proit'ssinn  capability,  ht'  tan 
predict  t'ut limit's  with  .i  rt'asonablt'  denrt'e  ot  accuracy  when  no  intormation 
i'.  available.  The  techninues  tfiat  have  bt'en  discusst'd  art'  means  I'v 
which  tht'st'  t'strapolat  ions  tan  bt'  manipulatt'tl  ami  a lompiisitt'  vit'w  of  a 
numt't'r  of  indivitliials  tan  t't'  obtaim'tl.  Yt't  in  tht'  t'liil  this  ctnisensus  is 
still  a sLibjt'ct  ive  est  imate. 


icln 


REFERENCES 


1.  Chernous'l^i’.  E.  L.,  "Weight  Factors  in  Expert  Estimates" 

Cybernetics  - A translation  of  Kiberuetika,  October  1974, 
pp  1021-1024. 

2.  De  Finetti,  Bruno,  "Does  It  Make  Sense  to  Speak  of  'Good  Probability 
Appraisers'?",  The  Scientist  Speculates,  I.  J.  Good,  A.  J.  Mayne,  and 
J.  M.  Smith  (ed.),  Basic  Books  Inc.,  New  York,  1962. 

3.  Easterling,  Robert  G. , "A  Personal  View  of  the  Bayesian  Controversy 
in  Reliability  and  Statistics ," IEEE  Transactions  on  Reliability 

Vol  R-21  , No.  3,  August  1972. 

4.  Hahn,  Gerald  J.,  "Evaluation  of  a Decision  Based  on  Subjective 
Probability  Estimates,"  IEEE  Transactions  on  Engineering  Management, 

Vol  EM-IB,  No.  I,  February  1971. 

5.  Hoerl , Arthur  E.,  and  Eallin,  Herbert  K.,  "Reliability  of  Subjective 
Evaluations  in  a High  Incentive  Situation,"  Journal  of  the  Royal 
Statistical  Society  Application  (1974),  Vol  137,  Part  2,  pp.  227-230. 

6.  Hogarth,  Robin  M.,  "Cognitive  Processes  and  the  Assessment  of  Subjective 
Probability  Distributions,"  Journal  of  the  American  Statistical 
Association,  Vol  70,  No.  350,  June  1975.  (Comments  by  Robert  L.  Winkler 
and  Ward  Edwards  with  Rejoinder  by  Robin  M.  Hogarth.) 

7.  Morris,  Peter  A.,  "Decision  Analysis  Expert  Use"  Management  Science, 

Vol  20.  No  9,  May  1974. 

8.  Murphy,  Allan  H.  and  Winkler,  Robert  L.,  "Forecasters  and  Probability 
Forecasts:  Some  Current  Problems",  Bulletin  of  the  American 
Meteorological  Society,  Vol.  52,  No  4,  April  1971. 

9.  Sackman,  H.,  "Delphi  Assessment:  Expert  Opinion,  Forecasting  and  Group 
Process,"  The  Rank  Corporation,  R-1283-PR,  April  1974. 

10.  Savage,  Leonard  J.,  IJie  Foundations  of  Statistics,  John  Wiley  and  Sons, 
Inc. , New  York , 1954. 

11.  Taha,  Hamdy  A.,  Operations  Research:  An  Introduction,  Macmillan, 

New  York , 1971 . 

12.  Tversky,  Amos  and  Kahneman,  Daniel,  "Judgement  Under  Uncertainitv: 
Heuristics  and  Biases,"  Science,  Vol  185,  27  September  1974. 

13.  Venn,  John  A.,  The  Locjic  of  Chance,  Macmillan,  London,  1888 
(Reprinted,  Chelsea,  New  York,  T962). 

14.  Willis,  Raymond  F.  "Aggregating  Expert  Opinion  in  Decision  - 
Making",  Decision  Sciences,  Vol.  7,  No  2,  April  1976. 


U)17 


HTLE:  Mjtidyenietit  of  Chdfige 

AUTHORS:  Mr  Frank  A.  Distasio.  Jr.,  and  MAJ 

US. Army  Concepts  Analysis  Agency 


Mitchell  L.  lionnett 


personnel  end 

Changes  are  the  er"d  orL^ ’?s^? ‘ volume  of  these 

ment  processes  including  sL'h  cri  ticaf‘'onL  independent  manage- 
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I . Introduction 

tach  year.  Army  units  experience  continued  personnel  and  equipment 
authorization  changes.  The  frequency  and  volume  of  the  changes  are  the 
end  products  of  a number  of  largely  independent  management  processes  in- 
cluding such  critical  ones  as  personnel,  materiel,  and  unit  Table  of  Or- 
ganization and  Equipment  (TOE)  developments.  The  interaction,  or  lack  of 
interaction,  of  the  management  processes  creates  a great  deal  of  frustra- 
tion and  unnecessary  equi pment/ personnel  turbulence  tor  many  units.  In 
order  to  address  Army-wide  turbulence  resulting  from  authorization 
changes,  a quantitative  methodology  was  developed  to  analyze  the  related 
activities,  events,  and  time-dependencies  of  selected  key  management  pro- 
cesses. 

A.  Management  of  Army  authorization  change  is  supported  by  a complex 
of  functional  processes.  Importantly,  the  autnori zati on  management  pro- 
cesses identified  by  the  study  group  span  a number  of  formal,  official 
Army  management  systems.  Preliminary  investigative  work  in  ttie  MOC  study 
identified  and  illuminated  the  key  processes  for  detailed  analysi s--wi th 
principal  emphasis  on  reduction  of  turbulence  caused  by  authorization 
changes.  As  a further  consequence  of  the  study  group's  preliminary  analy- 
sis of  the  overall  Army  authorization  change  environment,  quantitative 
variables  such  as  frequency  of  change,  time  and  the  schedule  factors  in 
accomplishing  changes,  and  volume  of  change  transactions  surfaced  as  im- 
portant contributors  to  turbulence. 

13.  The  principal  analytic  constituents  and  activities  of  the  MOC 
methodology  are  shown  in  Figure  1.  MOC  methodology  development  was  di- 
rected to  the  formulation  of  qualitative  and  quantitative  analytic  ap- 
proaches for  addressing  management  issues  and  key  problem  variables  ob- 
served in  the  authorization  change  environment.  At  the  same  time,  a spe- 
cific requirement  was  identified  for  a detailed  logical  structure  in 
which  to  view,  examine,  and  assess  tne  key  processes. 

II.  Functional  and  Qualitative  Considerations  of  Methodology  Hevelopment 

Investigative  and  problem  definition  work  constituted  the  initial  nv- 
thodological  venture  to  explore  the  MOC  problem  space--the  Arm>  authori- 
zation management  change  environment.  Investigative  and  definitional 
procedures  included  field  visits,  personal  interviews,  document  reviews 
and  data  collection  tasks  incident  to  MOC  study  objectives.  Coiwur- 
rently,  construction  of  a central  data  set  was  initiated  to  support  >ub 
sequent  methodology  development  and  analysis.  Management  systems,  »v- 
lated  key  management  processes  and  specific  procedural  activities  asso- 
ciated with  authorization  changes  Army-wide  were  reviewed  in  detail  to 
identify  important  functional  and  operational  aspects  of  the  Army's  cur- 
rent change  procedures.  Symptoms  of  turbulence  (e.g.,  late  completion  of 
TAAUS  updates)  were  identified  along  with  certain  qualitative  causes 


101 ‘I 


(e.g.,  the  issuance  of  conflictinq  change  guidance).  Several  problems 
were  observed  and  related  qualitative  prescriptions  developed  during  this 
investigative/definitional  portion  of  the  study. 

A.  i^ivotal  in  MUC  methodology  development  was  the  selection  ot  spe- 
cific key  management  processes  for  detailed  qualitative  and  quantitative 
analysis.  Investigative  analysis  revealed  the  criticality  of  certain 
processes  in  the  pattern  of  authorization  change  activity  spanning  At 
hierarchical  levels  from  HijDA  all  the  way  to  small  units.  Therefore, 
their  selection  provided  an  important  foundation  for  further  methodology 
development  and  analysis  of  Army-wide  authorization  change. 

d.  Structurally,  each  of  the  key  management  processes  consists  of  a 
number  of  events  and  activities  which  interconnect  to  fonu  procedural 
paths  over  which  authorization  change  transactions  flow  to  be  acted  upon 
and  documented.  Central  to  these  processes  is  The  Army  Authorization 
Documents  System  (TAAOS)  which  serves  a multiple  role  in  the  authoriza- 
tion change  environment.  TAADS  acts  as  a communication  medium,  transac- 
tion change  mechanism,  documentation  device,  and  data  bank.  Inter- 
faces and  common  linkages  exist  between  and  among  the  key  management  pro- 
cesses, basea  on  common  events,  schedules  and/or  types  of  activities. 
Multiple  process  interactions  often  occur  in  conjunction  with  PHDS  mile- 
stones resulting  in  authorization  changes  (e.g.,  unit  type  conversions) 
across  tne  Army.  Iherefore,  synchronization  of  event  schedules  for  indi- 
vidual or  combined  management  processes  is  an  important  requirement  for 
adherence  to  cyclic  PPdS  requirements. 

C.  The  complexity  of  the  individual  processes  and  the  richness  with 
which  they  interact  pose  particular  challenges  in  detecting,  identifying, 
and  measuring  quantitatively  the  causes  and  effects  of  change-driven  tur- 
bulence (occurring  as  a consequence  of  the  processes).  In  this  regard,  a 
critical  methodological  requirement  emerged  for  a systematic  structure  in 
which  to  analyze  and  evaluate  in  detail  the  selected  processes,  their 
constituents  and  their  interactions.  As  an  initial  step  in  building  such 
an  analytic  structure,  the  management  processes  were  modeled  descrip- 
tively by  construction  of  flow  diagrams  that  depicted  component  events 
and  activities.  The  resulting  diagram  models  established  a baseline  of 
functional  and  qualitative  information  (e.g.,  existence  and  interrela- 
tionships of  process  events  and  activities).  Construction  of  the  de- 
scriptive models  involved  numerous  quality  assurance  iterations  with  both 
staff  and  operational  sections  resulting  in  progressive  refinement  of 
information  for  the  flow  diagrams. 

III.  Methodology  and  Considerations  for  quantitative  Analysis 

In  conjunction  with  the  descriptive  modeling  work  described  above,  a 
detailed  investigation  was  required  to  identify  the  various  types  of 
quantitative  factors  which  would  support  a more  vigorous  analysis--fre- 
quency  of  activities/events;  acti vi ty/ovent  schedules;  activity  perfor- 
mance time  (duration)  requirements;  number  of  interactions;  volume  of 
workload  transactions  were  all  considered.  This  investigation  high- 
lighted the  importance  and  pervasiveness  of  time  and  schedule  interdepen- 
dencies among  the  critical  components  of  all  processes.  Based  upon  these 
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tindinys,  time  and  scheuule  considerations  became  predominant  as  quanti- 
tative measurement  criteria  tor  MOC  methodology.  Other  change-related 
factors  such  as  frequency  and  volume  (workload)  were  treated  in  MOC 
analysis;  however,  time  and  schedule  factors  were  selected  as  principal 
quantitative  measurement  and  analysis  criteria. 

Scheduling  considerations  centered  on  frequency  (e.g.,  times  per 
year)  of  occurrence  for  events  or  activities  and  on  calendar  date  (or 
process  milestone  date)  of  activity  start  or  completion.  Ihe  analytic 
focus  on  time'  criteria  therefore  involves  determining  the  required  time 
to  perform  each  given  activity  within  a selected  process.  The  ability  of 
Anny  organizations  to  meet  activity  or  event  schedules  is  largely  depen- 
dent on  the  time  allowed  in  the  authorization  change  management  pro- 
cesses. Ihis  is  a particularly  critical  consideration  since  missed 
schedules  contribute  to  the  atmosphere  of  turbulence. 

li.  Consistent  with  time  and  schedule  dependencies,  findings  concern- 
ing MOC  study  data  activities  involved  collection  of  detailed  event 
(schedule)  data  and  activity  performance  (time)  data.  Data  sources  in- 
cluded functional  organizations  and  personnel  throughout  the  Army  quali- 
fied to  provide  schedule  and  time  estimates  for  activities  within  the  key 
management  processes  based  upon  actual  experience.  Activity  duration 
estimates  represented  expected  (elapsed)  time  values  in  the  current  Amiy 
authorization  management  environment.  Schedule  data  consisted  of  a mix 
of  officially  regulated  event  dates  and  actually  experienced  event  dates 
associated  with  the  management  processes.  Quantitative  data  acquisition 
procedures  required  quality  assurance  iterations  for  data  refinement  and 
veri f ication. 

IV.  Use  of  Network  lh^t;;y 

The  key  Army  management  processes  incorporated  the  time  and  schedule 
variables  which  cause  much  of  the  authorization  change-related  turbu- 
lence. Technically,  these  processes  exhibited  specific  activity  or  event 
orientations  and  time-dependent  properties  which  rendered  them  amenable 
to  rigorous  analytical  treatment  based  on  the  principles  of  network  the- 
ory. building  on  the  functionally  oriented  flow  diagram  models  for  each 
of  the  selected  management  processes,  technically  oriented  network  formu- 
lations were  derived.  These  network  f oniiul ations  provided  a highly 
structured, descriptive  and  quantitative  means  to  analyze,  illuminate,  and 
assess  authorization  change  problem  variables  and  interactions.  Most 
importantly,  for  MOC  analysis,  an  operational  network  methodology  offered 
a capability  to  postulate  and  evaluate,  quantitati' ely , the  consequences 
of  alternative  activity  and  event  schedules  (e.g.,  earlier  start  of  se- 
lected events),  and  differing  activity  performance  times  (e.g.,  reduced 
time  to  perform  authorization  management  activities  of  a given  type). 

The  following  subparagraphs  discuss  major  considerations  in  transforming 
the  functional  information  developed  in  the  investigative  and  defini- 
tional portions  of  the  study  into  technical  network  constructs  to  support 
tne  quantitative  analysis  upon  which  the  principal  results  and  findings 
are  based. 
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A.  Networks.  A network  (or  linear  ^rapli)  is  a matneniat ical  aostrac- 
tion  from  the  real  world  in  which  certain  points  (or  iKulesl  are  coniu'cted 
lines  (or  arcs),  iionerally,  the  network  concept  includes  a flow  of 
materiel  through  the  nodes  and  arcs.  Ihe  functional  manai)eiiient  processes 
selected  for  MOC  analysis  evhihit  properties  which  are  generally  tvlat- 
aPle  to  a gt'neric  class  of  network  models  called  activity  networks.  As 
previously  indicated,  authorization  iiiange  schedules,  time  durations, 
and  frequencies  are  contri outory  factors  in  turhulence.  lo  provide  spe- 
cific insights  into  the  causal  relationships,  time  analysis  of  activity 
networks  for  tfie  selected  management  processes  is  a reasorihle  method  of 
providing  direct  quantitative  information  concerning  time  Uvlays,  intra- 
and  inter-process  synchronization  prooloiiis.  and  sequencing  or  scheduling 
difficulties  which  lead  to  turoulence  in  nrmy  organizations.  Moreover, 
such  analysis  provides  a Oasis  for  nominating  and  testing--in  technical 
network  f orm- -al ternat i ve  process  times  and  schedules  for  ultimate  func- 
tional application  in  reducing  turhulence. 

(1.  1 eniii nol oijy . 1 ime/schedul e activity  networK.  moileling  of  func- 

tional processes  ( such  as  those  selected  for  MdC  analysis!  required  ter- 
minologLy.  symhology.  ano  conventions  which  estahlish  a basic  discipline 
tor  network  formulations. 

1.  In  targeting  the  MOC.  network  formulation  to  Army  authorization 
change  management  processes,  several  applicable  tenns  and  definitions  are 
tabulated  in  Table  1. 

1.  fundamental  requirements  for  construction  of  time-dependent  ac- 
tivity event  schedule  networks  include; 

a.  Specification  of  a>.tivities  and  events  which  constitutes  eai  h 
network.  for  MOC  networks,  the  original  functional  flow  diagrams  pro- 
vided a ready  basis  for  satisfying  this  requirement. 

b.  Definition  of  linkages  of  events  ano  activities  to  reflect 
interdependencies  among  events. 

c.  tstimation  of  time  required  tor  eacli  activity  (if  feasible, 
include  statement  of  uncertainty). 

To  extend  such  fundamental  requirements  to  MOC  network  construction. 

Table  i contains  a list  of  buiKiing  blocks  to  accentuate  the  component 
elements  and  actions  in  network  composition. 

d.  In  addition  to  the  foregoing  considerations  of  network  building, 
the  following  specific  composition  I'ules  apply  for  tne  MOC  study. 

a.  All  activity  paths  leading  to  an  event  iiiust  be  completed  be- 
fore that  event  can  occur. 

b.  No  activity  can  start  until  its  originating  event  nas  oc- 

c.  fach  event  is  unique  and  cannot  supersede  itself. 


U'.' 


curred. 


Kible  1.  lenns  and  Definitions 


Table  2,  Network  Building  Blocks 

I Collection  of  existing  information  on  current  management 
processes  (functional  and  temporal). 

• Selection  and  identification  of  milestone  events  and  activity 

designations. 

I Sequencing  of  interim  events  and  activities  and  establishment 
of  interrelations  so  that  a network  is  developed  to  depict 
a logical  progression  to  completion  of  a process. 

• Detailed  refinement  of  time  estimates  required  to  complete 

the  activities  defined  by  starting  and  ending  events. 

I Correlation  of  information  on  processes  in  order  to  fonmilate 
interprocess  linkages. 
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4.  Network  O'ioyrjm  eooveiitions  tor  MUC  ukIuOo  tiie  tollowiiiij: 

d.  Activities  (in  each  iiunagement  process)  are  representeo  Py 
network  arcs  (line  connections  petween  events). 

D.  Lvents  are  represented  oy  networks  nodes  (nunuiered  circles). 

c.  Network  flow  proceeds  from  left  to  ri<^ht  (no  arrowneuls  re- 
qui red) . 

d.  Condensed  descriptive  narrative  is  annotated  tor  each  activ- 
ity; 


Orqani zati onal  responsioi 1 (ties  are  indicated. 

Nature  of  activity  is  descrioed. 

e.  Numeric  time  entries  define  tiie  number  of  days  required  to 
perform  an  indicated  activity. 

f.  An  example  of  a network  constructed  for  MdC  is  found  at  Mqur 


C.  Computational  Requirements.  Construction  of  detailed  activity 
networks  in  accordance  with  the  rules  and  conventions  descrihed  ahove 
provided  a rigorous  anq  disciplined  set  of  models  of  the  key  authoriza- 
tion management  processes.  To  apply  these  network  models  in  the  analysi 
of  the  management  processes  which  they  represent,  operational  and  compu- 
tational capabilities  are  required  to  develop  and  provide  quantitative 
aata  on  the  effects  of  current  and  alternative  process  sequences  and 
schedules,  activity  time  ourations.  and  frequencies.  Table  a specifies 
the  types  of  computational  capaoilities  required  to  support  the  MUC  net- 
work analysis. 

0.  Network  Analysis.  Ihe  analytic  requirements  and  corresponding 
operational  and  computational  capaoilities  defined  aoove  indicate  the 
specific  orientation,  scope,  and  complexity  of  the  quantitative  ap- 
proaches needed  to  address  causal  factors  in  change-driven  turbulence. 

Of  particular  importance  are  responsive  computational  and  operational 
techniques  for  use  in  formulating  explicit,  prescriptive  alternatives  to 
current  Army  authori zation  management  processes.  The  activity  or  event 
orientation  of  the  MOC  networks  and  the  time-dependent  scheduling  and 
synchroni zati on  problems  inherent  in  authori zation  change  management, 
signal  the  need  for  the  specific  types  of  analysis  prescribed  in  Table  a 
A discussion  of  network  analysis  concepts  and  techniques  which  offer  the 
requisite  capabilities  for  MOC  analysis  is  offered  oelow. 

1.  Generally,  developments  in  networx  theoretic  problem  solving 
concepts  and  associated  computational  methods  iiave  kept  pace  with  the 
need  for  knowledge  and  application  techniques  in  the  implementation  and 
use  of  network-based  methodologies.  Relevant  to  the  MOC  study,  many  se- 
quencing and  scheduling  investigations  can  be  analyzed  as  problems  m 
network  (and  graph)  theory,  further.  prob)ems  of  the  nature,  scope,  and 
scale  associated  with  Army  authorization  change  processes  are 
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computational 1>  teasiole  <vith  currently  available  solution  methods  and 
operational  tools. 


I.  Ot  significance  in  the  HOC  study  is  the  ability  of  such  tools  to 
supply  information  about  the  length  of  time  involved  in  a managoment  pro- 
cess (network)  and  about  the  particular  activities  on  wfiich  the  process 
duration  depends.  Operational  tools  for  complex,  large-scale  network 
problem  solution  are  characteristically  embodied  in  computer-based  appli- 
catiofis  programs  or  utility  software  packages  which  are  documented  and 
readily  available  in  trie  automatic  data  processing  (ADP)  marketplace.  On 
an  annual  Oasis,  the  repetitive  occurence  of  tne  various  networks, gi ven 
the  unique  frequencies  of  each,  resulted  in  over  ^?,000  activities.  The 
number  of  activities  and  the  analytic  requirements  of  the  nature  pre- 
scribed in  Table  i define  the  specific  properties  and  capabilities  of  the 
operational  tools  needed  for  MOC  network  analysis.  Some  major  features  of 
the  automated  capability  acqui’^ed  to  provide  computer-aided  support  for 
MOC  network  analysis  are; 

a.  Readily  achieved  operational  status  on  the  CAA  computing  sys- 
tem. 

b.  User-oriented  formats  to  facilitate  digitization  of  the  net- 
work data. 

c.  Automated  operational  procedures  and  computational  algorithms 
which  satisfy  specific  MUC  network  analysis  needs  and  provide  detailed 
quantitative  data  on  alternative  problem  approaches.  (Reference  Table 
J). 

d.  Computer-based  graphics  capabilities  which  produce  network 
diagrams  rapidly  and  automatically  based  on  alternative  solutions  derived 
from  MOC  prescriptive  analyses. 

J.  The  OPTIMA  1100  Project  Management  System  was  selected  as  the 
principal  operational  tool  for  performing  the  automated  network  analysis. 
OPTIMA  1100  is  a system  of  modular  routines  which  permit  detailed  time, 
resource,  and  cost  analysis  of  large,  complex  network  groupings.  OPTIMA 
can  be  operated  on  any  UNiVAC  Series  Iluu  computer,  to  include  the  CAA 
UNIVAC  Model  110».  For  the  MOC  study,  the  OPTIMA  lluu  time  analysis  fea- 
ture provided  the  capability  to  support  the  necessary  scheouling,  se- 
quencing and  synchroni zation  analysis  of  the  network  diagran;s.  An  ex- 
ample of  the  output  provided  by  OPTIMA  (Figure  3)  corresponds  directly 
with  tne  manually  developed  and  drawn  network  shown  at  Figure  2. 

V . Application  of  the  Methodology 

The  preceding  discussion  covered  major  considerations,  issues  and  ap- 
proaches concerning  tne  development  of  the  MOC  study  methodology.  The 
resulting  technical  network  models  of  selected  key  authorization  manage- 
ment processes,  along  with  related  solution  techniques  and  operational 
tools,  form  tne  analytic  base  for  application  of  the  methodology  to  de- 
velop prescriptive  alternatives  to  the  current  Army  authorization  change 
environment.  Central  to  the  MOC  study  methcdology  application  and  the 
derivation  of  study  results  was  the  use  of  manual  quantitative  analysis 
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procedures  in  coiwert  witii  d computer-based  network  solution  tool  dinuired 
to  aid  the  analytic  effort.  1 he  actual  applii.ation  of  the  me tliodolonv 
has  resulted  in  a unique  set  of  compatible  descriptive  network  diaqums 
lor  viewing  the  authorization  manaqemt'nt  processes  and  viable  alternative 
schedules  which  should  reduce  the  turbulence  inherent  in  the  current 
author  izat  ion  env  i roninent . 
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T 1 TLK ; A Method  for  Vulidallnj;  Missile  System  Simulation  Models 

Al'THOK:  Thomas  P.  Tytula 

U.S.  Army  Missile  Kesearcli  and  Development  Command 

ABSTRACT:  A method  for  deciding;  whetiier  a missile  system  simulation  model 

is  sufficiently  accurate  for  a specific  purpose  is  presented.  The  procedure 
uses  time  series  transfornuitlons  to  generate  ensemble  statistics  for  tlie 
simulation  error  associatei!  wltti  missile  system  perforruuice  parameters  of 
Interest.  Well  known  form.il  decision  tlteory  metliods  can  then  be  used  to 
determine  whether  the  model  is  adequate.  Wlille  not  specifically  addressed, 
the  procedure  is  generally  .applicable  to  models  other  tiian  missile  system 
s imulat ions . 
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A MfTHUn  KOK  VAl.lPATlNi:  MISSU.K.  SYSTl-M  SIMUIJVI  ION  MOm-l.S 


lU' 

riionuis  r.  Tytiila 

II, S.  Armv  Mlssll**  K<'s«*arc'h  ami  I'tsvelopmoiU  ('ommaiul 
I ut  rovUu- 1 1 on 

The  ovor  luoroa.s  liiy;  cost  ot  actual  missile  fllulit  tlrinps  Imposes 
severe  rest  r let  lt.>ns  vmi  tlie  number  of  suoli  tests  that  can  he  coniliicted  tlur- 
in^t  the  development  ol  anv  new  system.  Similar  constraints  are  Imposed  on 
tiu-  experimental  testlnn  ol  modifications  to  existing  missile  systems.  As 
a consenuence,  it  Is  necessary  to  rely  more  heavily  on  mathenwit leal  models 
which  simulate  the  per  1 i'rm.tnce  of  the  real  missile  system.  This  retjvilre- 
nent  tor  Increased  relUince  on  simulation  has  sllmulateil  eftorts  to  ilevelop 
methodologies  to  valKlate  these  models. 

Althoujth  there  has  been  an  Incrt'ase  in  activity  directed  toward  ci>m- 
puter  slmulatlori  validation,  a universally  .icceptable  approach  has  not  yet 
come  torth.  Indeed,  Navlor  ai  1 Klitper's  statement  (21  that  "the  i>iohlem 
ot  verlfvln>t  oi  valldatlny;  computer  models  remains  touay  perhaps  the  mi>st 
elusive  of  all  the  unsolved  me  thodo  1 o>t  lea  I probli'ms  associated  with  compute 
slmvilatlon  technliiues"  appears  to  he  as  true  tod.iv  as  It  was  ten  years  ago, 
I'here  se«-m  to  be  two  problems  cont r 1 but  1 n>;  to  this  situation.  The  first  Is 
the  lack  ot  .i  crlteru'u  ti’  use  in  liulylni;  the  validity  ot  slmul.ition  models 
Ihe  second  is  the  nature  I't  the  process  output,  which  tvplcally  consists  of 
a sciiuence  i't  Ci’rrelateil  variables  evolvlnn  over  time.  This  secoiiil  problem 
conttlbiites  to  the  first,  sinc»'  the  usu.ll  statistical  techniques  tor 
Inilepenilent  raiiili'm  v.iri.ibles  are  not  vlirectly  usable.  In  this  paper  we 
ili'Scvlbi'  a pii'i'e.lure  li>r  use  on  missile  system  slmulatioi\s  that  circumvents 
t tu-se  prob'.i-ms. 

The  iletinttlo(\  ot  a criterion  for  statiny  that  a simulation  1:;  valid 
is  linki'il  ilireitlv  to  the  ilefinltlon  of  valliiation.  For  the  purposes  of 
this  p.iper  , a simulation  will  be  C('ns  lilereil  val  Ul  If  the  difference  between 
the  process  I'utput  and  the  simulation  output  is  small  enouph.  What  con- 
st Ituti's  "sm.ill  enough"  ilepetiils  on  the  use  to  which  the  simulation  results 
will  be  put.  Tor  instance.  If  the  cost  ol  a wrong  inference  using  the 
slmvilatlon  initput  is  small,  then  a large  error  can  probably  be  tolerateil, 
aiul  vice  versa.  Setting  the  tolerance  for  validation  Is  a decision  problem 
that  ilepi  nils  on  the  Inteiuled  use  of  the  simulation  results,  and  as  such.  It 
can  be  hnndleil  bv  airy  of  the  well  known  ilecislon  models  that  are  available 
toilav  once  the  nature  of  the  slmulatliui  error  Is  deflneil.  The  remainder  of 
this  paper  describes  a metlunl  for  comparing  simulation  .and  flight  test  re- 
-sults  aiiil  Illustrates  this  method  by  a simple  example. 

I'roblen  _S_t^x t erne n^ 

The  ultimate  per f orm.»nce  of  .mv  missile  system  Is  emboilleil  In  Its 
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position  in  space  as  a function  of  time.  For  weapons,  the  point  on  this 
trajectory  relative  to  the  target  at  the  time  of  warhead  event  constitutes 
the  weapon's  miss  distance,  an  extremely  important  characteristic.  Wtiile 
the  trajectory  is  the  ultimate  measure  of  performance,  there  are  many  other 
performance  variables  that  influence  the  trajectory  and  may  also  be  of 
interest.  For  purposes  of  illustration,  we  confine  ourselves  to  a single 
variable  which  could  typically  be  one  of  the  components  of  the  position  in 
space  vector.  On  any  missile  flight,  the  actual  value  of  this  variable  is 
usually  measured  experimentally  during  the  course  of  the  test.  The  actually 
observed  value  is  governed  by  the  characteristics  of  the  atmosphere  tlirough 
which  the  missile  flies,  the  physical  characteristics  of  the  missile  itself, 
and  perhaps  even  the  characteristics  of  the  target,  and  is  further  confounded 
by  errors  in  the  measurement  process  Itself.  These  influences  on  the  missile 
are  random  in  nature;  hence,  their  magnitude  may  be  treated  as  a random 
variable.  Figure  1 illustrates  this  situation. 


Target 

Noise 


Atmospheric 

Noise 


Noise 


Measurement 

Noise 


Observed 
Variable,  Z(t) 


Figure  1.  Missile  Flight  Test  Block  Diagram. 

The  observed  variable,  7.(t),  is  a continuous  random  variable  since  the  inputs 
to  the  process  are  random  variables.  However,  7.(t)  is  usually  observed  only 
at  a fixed  time  Interval.  It  is  therefore  convenient  to  consider  instead 
the  sampled  variable  which  is  a discrete  random  variable,  Z , evolving  over 
time,  commonly  called  a discrete  time  series. 

One  of  the  major  problems  associated  with  statistical  analysis  of 
flight  test  results  is  that  each  of  the  points  on  the  observed  time  series  is 
highly  correlated  with  its  neighbors  by  virtue  of  the  inertia  in  the  system. 
Hence,  the  methods  of  statistical  analysis  that  are  based  on  the  assumption 
of  independence  between  these  points  cannot  validly  be  used.  The  implication 
of  this  circumstance  is  that  the  observed  time  series  is  a sample,  of  size 
one,  of  all  the  possible  time  series  that  could  have  been  realized  from 
this  process.  In  general,  the  observed  time  series  is  a stochastic  process 
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having  a joint  probability  density  function  f (z  z ,..z  ). 

t L . . .1.  t , t _ t 
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Each  realization  of  the  process  can  be  considered  independent  of  all  other 
realizations,  and  the  moments  can  be  estimated  as  a function  of  time  by 
conducting  a number  of  tests  under  the  same  conditions.  This  requires 
multiple  flight  tests  at  each  point  in  the  missile  flight  test  matrix,  a 
technique  that  is  usually  prohibited  by  cost  constraints. 

On  the  other  hand  simulation  of  a missile  flight  using  a computer  model 
is  a relatively  inexpensive  process,  even  for  the  most  complex  of  missiles. 

By  incorporating  random  noise  models  of  the  atmospheric  disturbances,  the 
target  noise,  the  missile  noise,  and  the  measurement  noise  into  the  simula- 
tion, it  can  be  run  in  monte  carlo  fashion  as  many  times  as  needed  at  the 
same  test  conditions  and  estimates  of  any  necessary  moments  can  easily  and 
relatively  inexpensively  be  calculated  as  a function  of  time  using  well 
known  techniques.  The  problem  is,  how  does  one  go  about  determining  if  there 
is  any  difference  between  the  set  of  time  series  generated  by  the  computer 
simulation  and  the  time  series  observed  from  the  flight  test  when  only  one 
realization  of  the  latter  is  available. 

Methodology 

To  facilitate  a technique  for  comparing  time  series  from  simulation 
and  test,  we  assume  that  the  marginal  distribution  of  the  flight  test  time 
series  at  any  time,  1,  defined  as 
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is  gaussian.  This  assumption  is  justified  by  the  fact  that  the  top  level 
system  performance  variables,  such  as  tralectory  components,  are  functions 
of  a large  number  of  random  variables.  Hence,  the  central  limit  theorem 
will  tend  to  make  the  assumption  valid.  Accordingly,  the  marginal  dis- 
tribution at  any  time  is  completely  characterized  by  the  mean  and  variance 
of  the  distribution  at  that  time,  and  the  time  histories  of  the  mean  and 
the  variance  completely  characterize  the  process. 


To  find  estimates  of  the  ensemble  mean  and  the  variance  time  histories 
associated  with  the  simulation  model  output  Is  a simple  matter.  The  simula- 
tion model  is  simply  run  repeatedly  for  the  same  test  condition.  Each  run 
constitutes  a random,  independent  realization  of  the  flight  test  as  portrayed 
by  the  simulation  model.  The  mean  and  the  standard  deviation  at  each  sample 
time  can  easily  be  estimated  using  well  known  procedures. 

What  is  needed  is  a way  to  determine  the  mean  and  variance  of  the 
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actual  process  as  a function  of  time.  It  is  well  known  that  almost  every 
nonseasonal  time  series  may  he  aiiequately  represented  by  a model  of  the 
form 
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are  polynomials  in  the  backshift  operator  B 
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number  of  points  in  the  observed  time  series.  The  differencing  operation  is 
necessary  onlv  if  the  observed  time  series  is  not  covariance  stationary.  In 
this  case,  the  required  order  of  differencing,  d,  is  that  necessary  to  achieve 
stat ionar ity , which  is  determined  by  the  behavior  of  the  autocorrelation 
function. 


A model  of  the  form  of  equation  (2)  is  known  as  an  autoregressive, 
integrated,  moving  average  (ARIMA)  model  of  order  (p,  d,  q) . Methods  for 
fitting  such  models  to  time  series  are  fully  described  in  Box  and  .Tonkins 
(1).  I'here  are  also  numerous  .'■.rticles  in  the  literature  describing  such 
procedures.  Note  that  since  the  a are  gaussian,  then  each  of  the  Z is  also 
gauss  Ian.  ^ 

Suppose  we  let  w^  = Then  V'''  can  be  regarded  as  a transformation 

that  takes  a nonstationary  series  Into  a stationary  series,  which  can  be 
represented  by  a model  of  the  form 


2'(B)  w^  = d(B)  a^  . 


(3) 


S Ince 


the  w 
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series  is  stationary. 


all  of  its  stochastic  properties  are 


described  by  its  mean  and  its  autocovarlance  function.  These  same  properties 
are  also  captured  in  equation  (31,  and  hence  in  equation  (2).  '''herefore, 
since  a properly  fitted  ARIMA  model  of  order  (p,  d,  ql  embodies  all  of  the 
stochastic  properties  of  tlie  flight  test  rime  series  it  can  be  used  to  re- 
present the  test  data.  The  time  series  fitting  process  resvilts  in  a trans- 
formation of  the  test  data  into  an  alternate  form  that  captures  its  informa- 
tion content.  Furthermore,  this  representation  can  easily  be  used  in  a 
simulation  model  to  generate  sample  realizations  of  the  time  series  process. 
The  missile  system  simulation  model  anil  the  ARIMA  model  are  independent 
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models  of  the  process  In  question.  If  they  both  represent  the  same 
stochastic  process,  then  the  mean  time  history  and  the  variance  time  history 
from  each  model  represent  Independent  estimates  of  these  parameters,  and 
their  equivalence  can  easily  be  tested  at  each  time  by  well  known  statistical 
Inference  techniques. 


I'xample 

To  Illustrate  the  approach  descrlheii  above,  an  experiment  using  a first 
Older  linear  filter  was  conducted.  This  filter  was  driven  by  a unit  step 
function  with  an  additive  white  noise  step  process  superimposed.  The  Initial 
condition  was  taken  as  zero.  The  output  of  the  filter  was  sampled  and 
corrupted  by  a white  noise  pulse  process.  Klgure  2 Is  a block  diagram  of 
this  process.  The  filter  constant  was  arbitrarily  taken  to  be  0.7,  and  the 
Input  and  output  noise  standard  deviations  were  taken  as  0.1.  The  noise 
free  differential  equation  of  this  filter  was  solved  using  a Kunge-kutta 
integration  scheme  and  the  result  was  checked  against  the  well  known  analyt- 
ical solution  to  ruike  certain  that  the  integration  step  size  was  not  intro- 
ducing error.  The  differential  equation  was  then  solved  using  the  Kunge- 
Kutta  routine  with  the  input  and  measurement  noises  superimposed.  Fifty 
Independent  time  series  realizations  were  genirated  in  this  fashion,  the 
ensemble  mean  and  standard  deviation  time  histories  were  estinuUed  from  these 
realizations  and  are  displayed  in  Figure  1.  F.ach  realization  had  one  hundred 
anil  twenty  data  points.  (This  part  of  the  experiment  corresponds  to  exercis- 
ing the  missile  system  simulation  model),  .‘'t  random,  one  of  t tie  fifty  real- 
izations was  chosen  to  represent  the  flight  test  data  series.  This  series  is 
depicted  In  Figure  4.  Since  it  is  known  that  this  time  series  comes  from  the 
filter  process,  a properly  fitted  ARI>'A  model  should  yield  the  same  mean  and 
standard  deviation  time  histories  as  the  Runge-Kutta  solution. 


The  key  elements  in  identifying  the  proper  AUIMA  model  to  represent  a 
time  series  are  the  autocorrelation  function  and  the  partial  autocorrelation 
function.  The  most  satisfactory  estimate  of  the  k^  ' lag  autocorrelation. 


‘k’ 


is 


(4) 


where 


t-i 


(5) 


The  estimated  partial  autocorrelation  function  at  lag  k,  t'**  cal- 

culated from  the  well  known  Yule-Walker  equations. 
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Figure  2.  Filter  Block  Piagram. 


Figure  3.  Filter  Mean  and  StaiularJ  Deviation  Dlstorles. 
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Figure  4.  Random  Realization  of  Filter  Output. 
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Figure  5.  Sample  Autocorrelation  and  Partial 
Autocorrelation  Functions. 
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(6), 


where  the  estimated  autocorrelations  have  been  substituted  for  the  true 
autocorrelations.  The  equations  (6)  are  solved  successively  for  k=l,  2, 

...  k.  Both  the  estimated  autocorrelation  function  and  the  estimated  partial 
autocorrelation  function  for  the  sample  series  are  displayed  in  Figure  5. 

The  form  of  these  functions  provides  insight  into  the  form  of  the  ARIMA 
model.  The  steady  decay  of  the  autocorrelation  function  indicates  that  the 
process  is  stationary.  Its  ocillltory  nature  suggests  a mixed  autoregressive, 
moving  average  (ARMA)  process.  The  oscillitory  decay  of  the  partial  auto- 
correlation function  after  lag  1 confirms  this  and  indicates  that  an  ARMA 
(1,  1),  or  ARIMA  (1,  0,  1),  process  is  a strong  possibility.  Hence,  the 
model 


(l-(t),  B)  (Z^-Z)  = (1-0,  B)  a^.  (7)  , 

was  tried. 

For  a model  such  as  equation  (7)  the  true  autocorrelation  function  can 
be  shown  to  be  (1,  p.  77) 


^ = 


i+ej  - 


(8) 


^k  = ‘<’1  Pk-1  . k > 2. 

Substituting  the  first  two  estimated  autocorrelations  for  and  P2> 

equations  (8)  were  solved  for  0^  and  to  yield  the  estimates  = .98; 

0^  » .7.  Using  a nonlinear  least  squares  estimation  grid  search  procedure 

with  these  values  as  a starting  point,  and  estimating  the  mean  Z as  well, 
the  parameters  of  this  model  were  estimated  as 
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.90 


.907 

.92 

.1058 


The  tit  of  the  model  was  then  checked  by  testing  to  see  if  there  was  any 


reason  to  suspect  that  the  residual  sequence,  a , was  not  gausslan.  None 


was  found. 


In  order  to  use  equation  (7)  to  simulate  sample  realizations  of  the 
test  process,  some  initial  conditions  are  necessary  to  start  the  recursion. 
Although  in  this  experimental  case  these  conditions  were  known,  if  the 
time  series  represented  some  missile  system  perforirutnce  variable,  this 
would  not  be  true.  It  can  be  shown  that  for  any  ARMA  model  there  is  a dual 
model  of  the  form 


2>(K)  = e(F)  e^ 


(9) 


where  F Is  the  forward  shift  operator,  F7. 
F » u"' 


7.  , , and  C 
t+1  a 


Clearly , 


t t+i  a e 

;'he  model  of  equation  (9)  is  known  as  the  backward  model.  It  can 
be  demonstrated  that  both  the  forward  and  the  backward  models  have  Identical 
autocovariance  functions;  hence,  they  both  represent  the  same  stochastic 
process  equally  as  well.  Generally,  the  backward  form  of  the  model  can  be 
used  to  calculate  enough  points  to  start  simulating  the  recursion  model, 
equation  (71.  However,  In  this  case  the  root  of  the  autoregressive  portion 


■1 


of  the  model,  . is  close  to  unity.  Thus,  the  process  is  close  to  non- 


stationar Ity , and  it  is  known  tliat  such  processes  can  make  long  excursions 
from  the  mean.  Under  those  conditions,  the  backward  model  is  not  as  good  as 
usual.  To  circumvent  this  problem,  equation  (7)  was  simply  solved  for  the 
initial  condition  using  the  first  point  of  the  observed  series  and  choosing 
a^  and  random  from  the  appropriate  distribution.  T.g.,  expanding 

equation  (71, 


"0 


7^-7  (1-,M  -a^  + Oa^l/.^ 


(101 


was  used  to  obtain  the  necessary  starting  value  for  the  forward  recursion 


T ■ ^ * -''.-1  * "t  - '’“t-i 


(in. 


Choosing  the  values  of  the  a's  from  the  appropriate  normal  distribution. 


- 1 


lO-tO 


the  recurston  relationship  (11)  was  solved  to  obtain  50  sample  realizations 
of  the  "observed"  process,  and  the  mean  and  standard  deviation  time  his- 
tories were  calculated.  These  are  presented  in  Figure  6.  Figure  7 shows 
the  mean  time  history  superimposed  on  the  sample  obse.  .at  ion  from.  Figure  4. 
Figure  8 shows  the  mean  and  standard  deviation  time  histories  ot  both  the 
Runge-Kutta  (missile  system  simulation)  and  the  time  series  solution. 

Figure  8 indicates  good  agreement  except  for  the  first  twenty  or  so  points. 
However,  standard  tests  of  the  null  hypotheses  of  equivalent  means  and 
equivalent  variances  at  each  time  increment  show  that  the  null  hypothesis 
must  be  rejected  at  about  10*  of  the  points  with  a significance  level  of 
.01.  The  lack  of  agreement  nay  be  due  to  small  errors  in  the  time  series 
model  parameters  resulting  from  the  resolution  inherent  in  the  grid  search 
routine  used.  Nevertheless,  it  is  clear  that  the  concept  has  a great  deal 
of  promise. 

Discussion  and  Conclusions 

A proposed  procedure  for  making  statistical  comparisons  of  missile 
system  simulation  results  and  flight  test  results  has  been  presented.  It 
Involves  using  a time  series  model  to  capture  the  stochastic  properties  of 
flight  test  results.  Statistical  comparisons  can  then  be  made  on  ensemble 
means  and  variances  using  the  usual  normal  theory  which  is  familiar  to  most 
managers.  This  is  a strong  point  of  the  procedure.  The  example  presented 
above  demonstrates  that  the  procedure  works  in  general;  however,  statistical 
comparisons  Indicate  a higher  rejection  rate  than  was  hoped  for.  A sub- 
stantial portion  of  the  rejected  points  can  be  attributed  to  the  transient 
Introduced  by  the  time  series  start  up  procedure.  The  reason  for  the  re- 
maining areas  is  the  subject  of  additional  investigations.  Despite  these 
problem  areas,  it  is  concluded  that  this  is  a promising  approach. 
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US  ARMY  A\1A110N  HOARU 


What  IS  tiu'i’o  atu'ut  opi'i'at  loiia  I tosting  that  U i I'tA'ii'iit  i at  i-s  it  I'loiii  I'tiu'i' 
opfiMt  1 oils  rosea  roll?  Lot's  I'lrst  take  a look  at  what  oporat  i oiia  1 to'-tiiig  is 

Sl.lUl  1 


I'ho  iihioot  Ilf  iiporat  loiia  1 testing  is  to  Jotoriiii  iu‘  it  oqii  i piiioiit  will  sorio  its 
iiitoiuloil  I'urposo,  while  sii|'portiug  the  luorall  mission  when  I'poratoil  hv 
the  intoiuloU  user  iiiulor  the  expootoil  onv  i ronmont  a 1 ooiu! ' t i oils  . I'liiis  the 
I'oqii  1 roiiiont  s given  in  SliJe  1- 

a.  That  the  user  he  the  test  suhjeet. 


h.  I'liat  a realistic  tactical  situation  he  exainineil. 


c.  That 

The  emphasis 
as  rea  1 i s t i c 

Sl.lUl  1 Oil- 


real  ist  1C  measures  I'L  performance  he  vihtained. 

of  operational  testing  thi'ii,  is  on  man  sisli'iiis  simulation  in 
an  eiiv  1 ronment  as  possible. 


tlperat  iou.i  1 testing  was  sei'.irated  from  Ueve  I opmeiit  ,i  1 testing  In'  t he -Yi'ini 
because  developmental  testing  is  limited  to  .in  engineering  test  ot'  the  equip- 
ment ag.iinst  spec  i f i c.it  i oils  and  contr.ict  requirements.  We  h.i\e  le. lined  I'rom 
m.iny  paint'ul  occ.isions  th.it  eipiiiiment  c.iii  meet  its  spec  i f i c.it  i ons  .iiul  still 
not  he  useful  in  the  field.  11'  the  spec  i 1 i c.it  i ons  don't  viet'ine  useful  equipment, 
usi'less  equipment  c.in  iiu-et  the  spec  i tic.it  ioii'. . tlhviousU  t lien  oper.itioii.il 
testing  which  is  iiiulert.iken  in  order  to  check  the  usefulness  of'  equipment 
will  he  ilit'f'erent  from  development.il  testing  which  is  iiiulert.iken  to  .is^ure 
that  the  equipment  meets  spec  i t' i c.it  i ons  . 


In  oper.it  1 on.i  I ti-sting  we  ilivi  I with  t lu'  opi'ration  of  the  i-quipmeiit  h\'  t lu' 
expected  r.inge  of  milit.ir\’  personnel  under  field  conditions.  .Rince  both 
the  milit.ir\'  personnel  .uid  ihe  field  conditions  .ire  t.iri.ihles  w 1 1 li  gre.it 
il  1 \ ei's  1 1 y , s.impling  techniques  .ind  st.it  ist  ics  will  he  used  extensi\el\'  in 
oper.ition.il  testing.  Ue\  •- 1 opment  .i  1 testing  seeks  to  \eril\  th.it  equipment 
will  do  wh.it  it  is  designed  to  do.  lleiici'  it  confirms  design  qu.i  1 1 1' i c.i  t i ons  . 
Oper.ition.il  testing  seeks  to  determine  lu'w  well  the  design  is  suited  to  the 
needs  of'  comb, it  t iwu'ps  in  .i  simulated  comh.it  eiu  i ronment  . Hence  it  confirms 
design  lit  i 1 i r.it  ion.  In  .uldition,  most  v'per.it  i on.i  1 tests  seek  not  onl>  to 
ilefine  which  of  two  or  more  items  of'  equipment  perform  best  in  the  field, 
hut  .ifso  to  provide  ,i  me.isure  of  perform. nice. 


SUj'l  J 


li 


k 


rhcret'oro  operational  testing  tends  to  emphasize  definitive  ratlier  tlian 
eoniparat  ive  measures. 

Sl.inii  J Ol-l- 

t!hoice  of  Measures:  As  in  all  operations  researcli,  the  choice  of  measures 
in  .)perational  testing  is  crucial  to  the  success  of  the  test.  Choosing  your 
measures  is  an  art,  not  a science,  hut  a few  guides  .ire  availahie. 

SI.  I Hi;  3 

These  steps  are  not  peculiar  to  oiierational  testing.  However,  in  operational 
testing  you  generally  try  to  simulate  "real  conditions"  more  closely  than  you 
would  in  other  areas  of  operations  rescarcli. 

SLini;  5 Ol-l- 

Much  hut  not  .ill  of  the  data  required  in  operational  tests  must  come  from 
questionnaires  addressed  to  the  user.  Attention  to  the  level  of  data 
dictated  hy  the  design  of  the  questionnaire  will  often  reap  large  dividends 
in  the  usefulness  of  the  questionnaire.  S.  S.  .Stevens  years  ago  introduced 
tlie  concept  of  levels  of  data. 

si.ini;  4 

It  is  especially  important  that  this  data  classification  lie  considered  during 
the  design  of  questionnaires.  Many  of  you  are  familiar  with  this  data 
classification  model.  Tor  those  of  you  who  are  not,  I will  (irovide  a few 
brief  examples. 

si.im;  5 

This  is  nominal  data  or  nose  counting.  It  is  frequency  data  allowing  onl\- 
the  most  basic  statistical  manipulations. 

SLIDi;  0 

Tor  example,  here  all  you  can  say  is  that  the  011-5S  requires  the  most 
maintenance  and  the  Oll-b  the  least  in  the  opinion  of  100  crewmen. 

.SI. IDT  7 

On  the  other  hand,  you  could  have  asked  for  ordinal  data,  as  in  this 
examfile,  rather  than  nominal. 

SLIDT  8 

The  results  would  then  have  looked  something  like  this:  Here  you  would 
have  seen  that; 


a.  I'ho  0lt-&8  was'  ivlont  i f ioil  as  roqiiiring  the  most  maintenance  by  o5"ii 
of  the  crewmen  (.tin'  hiyjhest  percentajje  j . 

h.  The  All-1  was  identified  as  requirinjj  the  most  maintenance  hv  only 
dSI)  of  the  crewmen. 

c.  However,  SOI  of  the  crewmen  identified  the  All- 1 as  rt'qiurinj;  the 
second  most  m;i i nt enance . 

I'herefore,  with  tiiis  level  of  data,  you  can  conclude  that  the  OH-58  and 
the  AH- 1 constitute  a class  hv  themselves  in  maintenance  jirohlems  with  the 
nil- 1 and  011-0  requiriiifj  noticeably  less  maintenance  than  either  of  the  other 
two  aircraft.  Please  remember  that  these  are  synthetic  data  and  do  not 
represent  actual  results  of  questionnaires  or  tests. 

.Sl.inii  9 

In  order  to  shift  from  ordinal  to  interval  data,  it  is  necessary  that  you 
restructure  the  questions  from  generalities  to  specifics.  It  therefore 
takes  more  questions  and  also  more  knowledge,  both  on  the  p.irt  of  the 
questionnaire  designer  and  the  individuals  answering  the  quest ionn.ii re. 

If  you  can  tolerate  the  additional  questionnaire  size;  if  you  h.ive 
sufficient  knowledge  to  write  the  questions;  and  if  your  subject  |H>pulation 
has  sufficient  knowledge  to  answer  at  tliis  level;  then  the  amount  of  infor- 
mation gained  from  your  questionnaire  will  be  entuinced  considerably. 

.SLIDI-,  10 

With  interval  data,  you  can  obtain  specific  performance  information  on  the 
items  tinder  test.  Whether  you're  working  with  a questionnaire  or  other 
aspects  of  test  design,  you  generally  pay  a penalty  in  additional  test 
size  and/or  instrumentation  for  moving  tiji  the  data  scale.  As  a test 
designer,  whether  or  not  this  penalty  is  worth  paying  must  always  be 
cons idered. 

S1.10I-:  11 

The  difference  between  interval  and  ratio  d.it.i  in  questionnaires  is 
usually  due  to  opportunity  rather  than  construction.  In  taking  these  tyi'es 
of  measures  we  seldom  have  any  control  over  whether  or  not  the  sc.ile  of  measure- 
ment uses  a real  or  an  arbitrary  zero  iioint.  However,  we  should  be  sensitive 
to  this  point  because  proportions  are  meaningful  only  for  ratio  data. 

Sl.inii  IJ 

This  data  classification  system  is  especially  useful  in  the  prej'aration  vif 
questionnaires,  but  is  also  relevant  to  other  test  measures.  I'.enerally, 
the  highest  level  of  measurement  I'ractical  should  be  used. 

SLlDli  12  OIT- 
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Prohahly  the  most  distinguishing  element  of  operational  testing  is  its  reliance 
upon  traditional  population  statistics.  All  of  the  tools  of  operations  re- 
search are  appropriate  and  will  occasionally  he  used  in  operational  testing. 
However,  computer  simulation  and  war  ginning  .ire  generally  incompatible  with 
the  fundamental  mission  of  operational  testing,  which  is  to  test  actual  equip- 
ment in  an  actual  mission  environment.  riiey  will,  therefore,  seldom  he 
used. 

On  the  other  liand,  the  testing  of  actual  equipment  in  an  actual  environment 
is  a test  of  a variable  in  a varialile  setting  operated  by  various  people. 

I'his  is  a classic  definition  of  an  area  where  sampling,  and  therefore 
population  statistics,  are  appropriate.  Thus,  analysis  of  variance,  chi 
square,  "t"  tests,  etc.  dominate  the  test  designs.  Correlational  techniques 
on  the  other  hand  do  not  often  lend  themselves  as  well  as  statistical  tests 
to  making  decisions  among  choices  of  equipment.  However,  correlational  and 
regression  techniques  will  be  used  to  display  relationships  between  equipment 
and  performance  parameters.  Tliis  will  often  be  crucial  to  the  extrapolation 
of  test  data  to  untestable  situations  on  equipment.  Kor  example,  in  a 
Force  Development  Tactics  Kvaluation,  correlation  and  regression  techniques 
might  be  used  to  extrapolate  results  from  simulated  to  actual  threat  equip- 
ment based  upon  regressions  of  performance  pariuneters. 

In  summary,  the  object  of  operational  testing  is  to  determine  if  equipment 
will  serve  its  intended  purpose  while  su|iporting  the  overall  military 
mission  when  operated  by  the  intended  user  under  tlie  expected  environmental 
conditions.  This  imposes  a number  of  restrictions  on  test  design.  These 
restrictions  by  and  large  emphasize  the  use  of  population  statistics  at  the 
expense  of  gaming  and  computer  simulation.  Correlational  technioues  will 
be  used  primarily  to  extrapolate  the  data  to  untestable  situations  or 
equipment.  Questionnaires  are  an  essential  part  of  operational  testing. 

Using  S.  S.  Stevens'  model,  the  level  of  data  obtained  from  the  questionnaire 
should  be  as  high  as  the  length  of  the  questionnaire  and  the  knowledge  of 
both  the  questionnaire  constructor  and  respondent  permit.  Similarly  the 
highest  practical  level  of  data  should  be  obtained  from  all  aspects  of  the 
test  considering  the  penalties  of  test  size  and  instrumentation  sophistication 
which  will  be  required. 
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GUIDES  FOR  CHOOSING  MEASURES  FOR  OPERATIONAL  TESTS 
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NOMINAL  DATA  EXAMPLE 
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RESULTS  ON  NOMINAL  QUESTIONAIRE  ITEM  TO  100 


tde 


ORDINAL  DATA  EXAMPLE 
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INTERVAL:  ALLOWS  COMPARISON  AND  DEFINITIONAL  MEASUREMENT. 
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RELATIVE  VALUE  OF  DIFFERENT  TYPES  OF  DATA 
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An  Analysis  Toclinlque  lor  llelicoptor  Aim  lirror  Measiiremonls 

AUTHORS:  Dr.  Robert  S.  Bennett , Falcon  Researcli  ami  Development  Company 

Mr.  William  T.  I’lbil,  US  Army  Materiel  Systems  Analysis 
Ac  t i V i t y 

ABSTRACT:  This  paper  develops  a teclinique  lor  estimating  tlie  mean 

time  required  for  a lielicopter  to  meet  tlie  aim  requirements  for 
launching  an  autonomous  homing  missile.  'The  situation  considered 
is  that  in  which  a pilot,  operating  the  helicopter  near  hover,  attempts 
to  keep  the  longltud In.il  axis  of  the  aircraft  aimed  toward  an  air- 
borne target.  It  is  assumed  that  a launch  can  take  place  given 
that  the  angular  error  between  the  helicopter  axis  and  the  line  of 
sight  ti'  the  target  remains  within  a prescribed  limit  for  a period 
I't  time  sufficient  for  operator  response. 

I'his  launch  condition  may  be  described  in  terms  of  the  "zero 
crossing"  problem  often  encountered  in  signal  analysis,  where  a 
random  function  of  time  occasionally  crosses  a given  threshold  value. 
Statistical  techniques  for  determining  the  frequency  with  which  the 
random  tunctii'n  remains  below  a spt'cific  threshold  lor  a given 
perioi.1  have  been  published,  and  are  used  here  in  analyzing  the  helicopter 
aiming  requirements.  'The  mean  time  required  for  meeting  missile 
launcli  coinlitlons  is  derived  in  terms  of  publlslied  zero-crossing 
statistics,  titrougli  tlie  use  of  tlie  powi'r  spectrum  and  tlie  moments  of 
tlie  aim  error  distribution.  Input  ilata  are  obtained  from  fliglit 
test  data. 

An  example  is  given  for  a particular  fliglit  test  sequence.  Tlie 
lllglit  test  data  were  extensive  enough  to  permit  a direct  empirical 
det  erm  In.it  ion  of  tlie  nuMii  aiming  time,  and  tliis  was  used  to  evaluate 
the  accuracy  ol  the  zero-crossing  teclinique.  Advantages  of  the  zero- 
crossing teclinique  include  a signlt leant  reduction  in  the  quantity 
ol  I 1 ight  test  data  required  for  determining  tlie  mean  aiming  time  for 
a given  helicopter  and  target  combination,  witli  consequent  saving  in 
test  lime  and  expense  for  an  equivalent  result. 

Knowledge  ol  the  mean  aiming  time  is  of  Importance  in  determining 
tlie  suitability  of  a given  missile  system  to  helicopter  launch,  since 
tlie  ability  of  tlie  pilot  to  launch  his  missile  is  far  more  dependent 
on  aiming  accuracy  than  it  is  on  tlie  target  signal  intensity.  There- 
lore  this  technique  provides  far  more  information  for  missile  selection 
lor  helicopter  armament  than  does  the  simple  lock-on  boundary  often 
used  for  ground  launch. 
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TITLE : An  Analysis  Technique  for  Helicopter  Aim  Error  Measurements 

AUTHORS : Dr.  Robert  S.  Bennett,  Falcon  Researcli  and  Development  Company 
Mr.  William  1’.  Plbil,  US  Army  Materiel  Systems  Analysis 
Activity 

introduct ion:  Before  an  infrared-seeking  or  similar  autonomous  missile 

can  be  launched,  the  missile  must  be  oriented  such  tliat  the  angular  error 
between  the  line  of  sight  to  the  target  and  tlu’  missile  axis  is  within 
a prescribed  limit.  Furthermore,  this  angular  error  must  remain  within 
the  limit  for  a period  of  time  sufficient  for  operator  response.  In  most 
cases,  the  error  tolerance  increases,  and  the  operator  response  time 
decreases,  as  the  signal  on  which  the  missile  is  to  liome  becomes  stronger. 

A parameter  of  particular  Importance  is  the  time  required  for  meeting  the 
aiming  conditions,  since  excessive  aiming  time  may  preclude  a successful 
engagement.  In  the  special  case  of  an  Infrared  missile  launched  from 
an  airborne  helicopter,  the  mean  aiming  time  required  de|)ends  on  the 
slgnal-to-nolse  ratio  at  the  missile  detector,  the  skill  of  the  ope.rator  i>l 
the  missile  system,  and  the  ability  of  the  pilot  to  accurately  keep  Ins 
aircraft  aimed  at  the  target. 

This  paper  is  concerned  with  a method  for  piedictlng  t lie  mean  aiming 
time  for  an  infrared-seeking  missile  launched  I helicopter  against 

a fixed-wing  target  aircraft,  as  shown  in  Figure  le  missile  is 

assumed  to  have  an  initial  aim  error  tolerance  i.*'ich  i . iclated  to  t lie 
signal-to-nolse  ratio  in  the  manner  indicated  b\  riguit  . The  prediction 
method  is  baseii  on  some  publislied  zero-crossing  . itistics,  and  requires 
as  input  the  power  spectrum  and  moments  of  the  aim  error  distribution 
for  the  liellcopter  in  question.  These  inputs  may  be  obtained  from  a 
relatively  simple  flight  test  of  sliort  duration. 

A particular  example  is  given,  in  which  a UH-IM  helicopter  was  used 
to  track  a target  aircraft  crossing  t lie  path  of  the  helicopter  at  an 
angular  rate  of  about  five  degrees  per  second.  Aiming  error  was  measured 
with  a television-type  optical  tracker.  Tliis  device  produced  analog 
output  voltages,  proportional  to  the  elevation  and  azimuth  angles 
between  tlie  helicopter  longitudinal  axis  and  tlie  line  of  sight  to  t lie 
target.  Tapes  of  these  analogue  voltages  were  subsequently  used  in 
determining  the  power  spectrum  and  the  moment s of  the  aim  error  distri- 
bution. These  data  were  then  used  as  input  for  the  analysis  method  to 
be  described  here.  In  addition,  the  mean  aiming  time  was  empirical Iv 
determined  from  the  time  history  of  the  aim  point.  This  is  a more  time- 
consuming  procedure,  and  requires  flight  tests  of  longer  duration  t lian 
the  method  described  in  this  paper,  but  since  sufficiently  li'iig  flights 
were  in  fact  made,  it  provideil  a means  for  checking  the  zero-crossing 
method . 

Description  of  the  Method:  A representative  time  history  ol  the  heli- 
copter aim  error  is  shown  in  Figure  3.  Analysis  of  this  aim  error,  both 
in  the  case  of  the  Ull-IM  flights  and  in  previous  tests  involving  heli- 
copters aiming  at  ground  targets.  Indicates  that  azimuth  error  accounts 
for  nearly  all  of  the  total  angular  error.  i'ltls  is  not  ent  irelv  unexpected, 
considering  the  geometry  of  the  experiments;  a target  crossing  the  path  ol 
a helicopter  at  approximately  the  same  altitude.  In  additli'ii,  these 


angular  errors  have  been  found  to  closely  follow  a Gaussian  probability 
density  in  nearly  all  cases. 

If  the  maximum  allowable  error,  e , for  which  a missile  launch  is 

max 

possible  is  indicated  by  lines  at  e on  Figure  3,  the  result,  shown 

max 

in  Figure  4,  strongly  suggests  the  classical  "zero  crossing"  problem 
from  signal  analysis.  The  term  "zero  crossing"  is  something  of  a misnomer 
since  the  classical  problem  is  concerned  with  tlie  statistics  describing 
the  occasional  crossings  of  any  fixed  level  of  a random  variable. 

A particularly  useful  study  has  been  nvuie  of  some  statistical 
properties  of  zero  crossings  of  Gaussian  processes.  These  properties  were 
published  in  Techni<,'al  Report  AF-109  of  tlie  Carlyle  Barton  Laboratory  of 
the  Johns  Hopkins  I'nlverslty.  ("Statistical  Properties  of  Noise  Pulses", 

A.  J.  Rainal,  .lune  1964,  U.S.Air  Force  Contract  AF  33(657)-11029) . This 
report  considers  tlie  statistics  of  noise  pulses  wliich  are  produced  when 
Gaussian  noise  is  gated  in  such  a way  that  no  output  is  obtained  if  the 
noise  waveform  is  below  a fixed  threshold,  and  tlie  waveform  is  passed 
through  whenever  its  amplitude  is  above  the  threshold.  Among  the 
statistics  available  from  this  report  are  the  average  durations  of  these 
noise  pulses,  and  the  average  time  between  pulses. 

In  the  analysis  of  helicopter  aim  errors,  a similar  situation  exists 
in  that  the  missile  can  be  launched  provided  the  angular  error  remains 
between  two  thresholds  for  a given  period  of  time.  Thus  the  data 
in  AF-109  is  applicable  here. 

In  AF-109,  data  are  given  from  which  the  time  between  crossings  of  a 
fixed  threshold  by  a Gaussian  process  can  be  determined,  as  well  as  the 
duration  that  the  process  remains  above  the  threshold.  From  these  data, 
the  graph  shown  in  Figure  5 was  plotted.  This  is  a normalized  graph, 
with  the  abscissa  showing  the  threshold  value  in  units  of  standard 
deviations  of  the  Gaussian  process,  and  the  ordinate  in  units  of  the 
mean  time  between  sign  changes  of  the  Gaussian  process.  In  order  to 
use  Figure  5,  given  that  the  angular  errors  are  Gaussian,  all  that  is 
needed  is  the  power  spectrum  and  the  standard  deviation  and  the  mean  time 
between  sign  changes  of  the  Gaussian  process  could  be  used,  but  the  mean 
time  between  sign  changes  can  he  obtained  from  the  power  spectrum,  and  thi 
is  often  more  available. 

If  an  "event"  is  defined  as  having  occured  when  the  error  remains 
below  for  a time  equal  to  the  oiierator  response  time,  the  average 

time  between  events  can  he  read  from  Figure  5.  3’hat  this  can  be  done  will 
be  illustrated  by  the  following  example. 

In  the  UH-IM  experiments,  it  was  found  tliat  tlie  standard  deviation  of 
the  aim  error  was  l.lfl  degrees.  Krror  threshold  values  of  0.4,  0.8,  1.2, 
1.6,  and  1.8  degrees  will  be  considered  as  representative  of  various 
requirements,  for  different  signal  to  noise  ratios,  for  some  class  of 
infrared  missiles. 


Now,  oonslilor  tlu>  oaso  wlioro  tlio  operator  response  time  is  0.5 
seconds  and  the  0.8  decree  tliresliold  is  beinjt  considered.  An  "event" 
is  defined  .>s  having  occurred  wlienever  the  error  remains  below  0.8 
degrees  for  0.5  seconds.  When  the  duration  of  an  interval  during  which 
the  error  remains  below  0.8  degrees  is  l.b  seconds,  for  example,  the 
determination  is  nxide  that  three  events  have  occurred.  If  the  error 
remains  below  0.8  degrees  for  0.4i  seconds,  no  event  is  recorded. 

Now,  the  five  thresluild  angles  under  consideration  correspoiiii  to 
abscissa  values  of  0.3b4,  0.727,  1.091,  1.455,  and  l.b3b  on  llie  Figure  5. 
The  corresponding  values  of  the  ordinate,  for  time  intervals  above  and 
below  the  threshold,  are  shown  in  Table  1.  Because  of  t lie  symmetry 
of  Figvire  5,  only  the  values  for  positive  thresholds  are  sliown. 


Table  1.  Normalized  Zero  (Crossing  Intervals 


Absc i ssa 


Normalized  Time 
Above  Threshold 


Normalized  Time 
Below  Threshold 


0. 

, 3b4 

. 380 

0. 

, 727 

. 300 

1. 

,091 

.251 

1. 

.455 

.213 

1 . 

, b3b 

.195 

O.bd 
1 . 00 
1.4b 
2.  32 
3.20 


To  convert  the  norm.ilized  times  in  Table  I to  true  times,  it  is 
necess.jry  to  multiply  the  norm.ilized  v.ilues  by  the  mean  time  between 
sign  changes  ol  the  il.iussi.in  process.  For  ex.iraple,  in  tlie  OH-IM  tests 
the  mean  time  between  sign  changes  w.is  4.325  seconds.  This  value  was 
obtained  by  considering  the  power  spectrum  of  the  error,  wliich  w.is 
found  to  have  a "sh.ipe"  roughly  proport  ion.i  1 to  the  inverse  of  the 
frequency,  for  frequencies  between  0.05  .md  0.4  cvcles  per  second. 

Now,  for  a power  spectr.il  dens  i tv  iNffl  of  t lie  term: 


f ' for  0 ' t ' f 

W(f)  = 

0 otherwise 

and  O.iussi.in  distribution  with  mean  v.ilue  zero,  .is  is  the  case  with 
the  "bias-free"  d.it.i,  the  .iverage  number  of  sign  i-h.inges  I't  the  erroi' 
per  second  is  given  bv : 

I 

0 

N,  = v/  3 


Ith- 1 


Sinci'  tlu'  "cutoff"  froquoncy,  f^, , for  the  aim  orror  data  is  about  0.4 
cyclos,  the  averaito  rate  of  .sign  ctiango  is: 

\|  = O.l/l./.'i  = O.J.'ilJ  per  sc'ootul, 
or  1/N^  = 4..'iJ.S 

Mu  1 1 ip  !>•  ing  b>  this  valiio,  tlio  ontrios  in  Talilo  1 bocomo  those 
shown  in  Table  J. 


Table 

J.  Zero  Crossing  for 

Aim  Trror  Oat a 

Th  resho 1 d 

Average  Tine  Above 

Average  Time  below 

in  Oegrees 

Threshold  in  .Second; 

> Threshold  in  Seconds 

0.4 

1 . 044 

2 . o.S.i 

0.,b 

1 . ZOS 

4..a:.s 

1.2 

1 . OSo 

0 . .A  1 .S 

1 . (' 

O.OZl 

lO.O.AS 

1 ..b 

0.S4.A 

1 .A  . 84  1 

Now,  it  must  tie  reniemlierei.i  that  the  angular  "window"  within  which 
.1  missile  can  be  l.iunched  actually  consists  of  two  s\-mmetric  thresholds, 
one  leading  the  target  and  the  other  lagging  the  target.  To  account 
tor  tliis,  I'able  J must  be  modified.  I'he  Average  I'ime  Above  Vhreshold 
column  will  remain  as  it  is — the  time  above  0.1  degrees,  for  example, 
is  preciseli'  the  same  as  the  aierage  time  below  - 0.1  degrees  by  the 
s>  :etr>'  of  I'igure  5.  However,  when  the  error  is  below  0.4  degrees, 
part  of  the  time  interval  may  be  time  when  the  error  is  below  - 0.4 
degrees,  and  thus  out  of  the  window.  On  the  average,  the  error  will 
I'.i  1 1 outside  the  window  on  the  negative  side  once  for  every  time  it 
tails  outside  oti  the  positive  side.  I'his  means  that  the  times  in  the 
Aver.ige  lime  below  I'hreshold  column  should  he  reduced  b>'  the  times  in 
the  Average  lime  Above  Threshold  column,  and  the  result  divided  by 
two.  I'his  h.is  been  done  in  Table  .v , in  which  the  pair  of  thresholds 
.ire  designated  as  "windows". 

Next,  consider  a hypothet i c;i  1 flight  of  duration  100  seconds. 

It  IS  I'In  ious  til, It  the  number  of  intervals  during  which  the  aim 
erroi-  is  within  a window  can  differ  from  the  numher  of  intervals 
iluring  which  it  is  outside  the  window  by  no  more  than  one.  In  this 
.in.ilvsis  the  number  of  intervals  inside  will  be  taken  to  be  exactly 
the  s.ime  as  the  number  of  intervals  outside.  The  total  time  for  an 
aver.ige  excursion  consisting  of  one  interval  outside  a given  window 
.ind  one  interv.il  inside  will  be  the  sum  of  the  two  values  in  Table  .A 


1 0(v, 


r.ihlt'  J.  Wiiiik'w  liili'rv.ils  lor  Aim  Krror  Data 


Window  in 
hegrees 

Average  Time 
Outside  Window 

Average  Time 
Within  Window 

0.4 

1 . 844 

0.8  70 

0.8 

1.248 

1.514 

1.2 

1 . 088 

2.815 

1.8 

0.421 

4.557 

1.8 

0.84  1 

8.444 

tor  tho  viindv-'w  of  intorost.  Vlnis 
liuriiin  tito  lOU  socowii  fli^kt  is: 

Wind ow 

0.4 

0.8 

1.2 

1.8 

1.8 


iho  mimbtM-  of  such  excursions 


Nunibor_  of  Incursions 

100/2.114  = 43.22 
100/2.812  = 35.58 
100/3.701  = 27.02 
100/5.478  = 18.25 
100/7.  142  = 1 1.82 


Now,  lor  t lio  live  wiiulows,  the  nuinher  anO  mean  liurat  ton  of  the 
intervals  liurinj;  which  the  erri’r  is  within  the  winOow  are  known  for 
the  100  second  flight.  Also,  the  total  time  spent  outside  the  window 
is  known.  These  are  showai  in  Tahle  4. 


Table  4.  Aim  Krror  St.it  istics  for  .1  100  Second  Flight 


Number  of  Interv.ils 

Average  Ourat ion 

Total  I'ime 

Within  Window 

lnterv.il  Within 

Out  side 

Window 

Window 

Window 

"N" 

"n" 

• 0.4 

4 1.22 

0.870 

71  04 

‘ 0.8 

15.  5h 

1 . 51.. 

4 0 . 10 

* 1.2 

27.02 

2.015 

24.  14 

♦ 1.8 

18.25 

4.557 

10.81 

' 1.8 

1 1.82 

0.444 

11.48 

In  order 

to  obtain  the  mean 

w.iiting  time  hetvv'cen 

"event  s". 

as  was  done  in  the  empirical  analvsis,  the  mimher  ot  events  in 
the  too  second  flight  must  bo  calculated.  This  could  he  done  by 
multiplying  the  number  of  intervals  within  a window  by  the  aver.ige 
duration  of  the  interval  aiui  dividing  by  the  operatv''r  response  time, 
wore  it  not  for  the  tact  tliat  some  intervals  are  much  shorter  than 
.average,  and  may  not  be  long  enough  for  an  event  . This  is  ,i  part  icularlv 
bothersome  problem  when  t he  n.irrow  wiiulow  and  long  response  time 
combinations  are  considered. 


1(1('' 


The  distribution  of  interval  durations  about  the  mean  follows, 
approximately,  a Poisson  distribution.  This  fart  can  be  used  in 
determining  the  percentage  of  Intervals  which  should  be  added  to  the 
time  outside  the  window  in  calculating  the  mean  waiting  time  between 
events.  This  percentage  can  be  expressed  as  a function  of  the  ratio 
of  operator  response  time  to  the  average  duration  within  tlie  window. 


Response  Time 


R/D 


0.  I 
0.5 
l.O 
2 

10 


Average  Durat ion 
of  Interval 


Percentage  of  Intervals 
Containing  no  Event 

"p" 

1 

20 

50 

80 

‘19 


The  total  number  of  events,  for  a given  window  and  response 
time,  is  therefore 


Events 


R 


il 


100'^ 


where  R is  the  operator  response  time 


The  total  waiting  time  between  events  is 


Wait 


T + 


PD 

100 


The  mean  waiting  time  between  events,  which  is  tlie  final  result 
is  tiien: 


Mean  Waiting  Time:  — 

^ Events 

I'or  cxamiilc,  ii\  the  case  whore  a window  of  - 1.2  degrees,  and  an 
operator  respottse  time  of  O.o  seconds  is  cons  idereil , 

N = 2:".  02  n = 2.t'l.'i  T = 29.54 

R = O.b  R D = .229  p = o.p 


2'  ^2.bl.5 

■ “ O.o  ■ 


1 vents  = "■'—.^-.•-'1'--  ^1  . ) = 109.O 


0.9 
1 00^ 


Wait  = 29.31  (2.01.5  \ ‘'■•■ll  = 31.2 

' 1 00 

Mean  Waiting  Time  = .28  seconds. 


I'tie  complete 
operator  response 
missile  launch  is 
operator  response 


set  of  mean  waiting  times,  for  fice  windows  and  ten 
times,  is  showtt  in  fable  5.  fhe  full  time  required  for 
the  sum  of  the  mean  waiting  times  in  I'.ible  5.  plus  the 
time.  This  full  time  is  shown  in  figure  o. 


lObb 


rattle  5.  Meai>  Waitiiii;  Time  Between  1. vents 


sponse  Time 
(Seconds ) 

Ma.'  imum 

Allowed  Align  l.ir 

lirror 

in  Degree 

0.1 

0.8 

1 . J 

. {' 

1.8 

0.  1 

. 75 

. 00 

.04 

.07 

.01 

0.: 

. 5.S 

. 18 

.08 

.04 

.0.4 

o..> 

. ss 

. 1.4 

. Oo 

.04 

0.4 

1 . 

. .48 

. r 

. 08 

.0.4 

0..S 

1.81 

.40 

. 7 J 

. 10 

.07 

O.o 

: . 04 

.01 

. 78 

. 1.4 

. 08 

0.  ' 

.^.45 

.■74 

. ,47 

. l.s 

. 00 

o.s 

4.48 

. 8" 

. .48 

. 1" 

. 1 1 

0.0 

7.84 

1 .0.4 

.4.4 

.70 

. 17 

1.0 

8 . .S  1 

1 ..’4 

.40 

•> 

. 11 

For  comparison,  l'ii;ure  7 shows  the  t'nll  time  required  for  missile 
launch  as  determined  by  direct  measurement  from  a large  number  of  test 
flights  of  the  Illl-IM.  It  will  he  noted  that  although  the  direct  measure- 
ment required  much  more  data  th,in  that  required  by  the  zero  crossing 
technique,  the  results  are  in  close  agreement. 
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1'  I ri.l'', : I'l'i- 1 s 1 on  Risk  Analysis  - AVSCOM  Manancmi'nt  Ti)!' 1 

AUniOK:  Mr.  I’. ml  R.  Sli.iplro 

I'S  Armv  I'roop  Snppin  t aiul  .\v  lat  ion  MatiTlol  KiMdlnivis  I'omm.iml 

AR.'VrKAtJ_r : rills  now  man.i>;t'mont  tool  nsi's  a pi  ovon  Aniiv  toolinloal  tool: 

I'oolslon  Risk  Analysis  (.I'R.Al  . I'RA  1 1.  iisi'il  1 1>  iiukIoI  iii.iloi  on->;olnn  Armv 
programs.  I'lio  iiioil<-l  Is  llic'ii  mod  1 1 iod  on  .i  oont  Inning  basis  to  oonloiiii 
to  ohangos  ill  tlio  program.  I'nigiMiii  oost,  solu'dnlo  and  por f orm.niot'  o.ni  bo 
K'okod  .It  s limi  1 1 .moons  1 y . liont  liuunis  oxori'lsing  I't  bRA  rosults  In  a Ilow 
I’t  tlmoly  lnlorm.it  Ion  to  program  doolslon  makors.  Program  .i  1 1 orn.it  I vi's 
o.in  bo  looki-d  .It  l.ir  in  advanoi';  1 nt  «'m' lat  lonsli  ips  I't  various  program 
.lotlvitli-s  .md  v.irions  pri'gr.iiii  .i  1 1 ornat  Ivos  oan  In-  stndli'd.  Program  oon- 
trol  Is  Improvo.l  t broiigli  t bo  I'l'iit  1 niions  traoking  ol  tlio  program.  Tbo  I'b- 
It'ot  ivo  ot  oont  Innoiis  nso  ot  PR.As  Is  to  provldt'  progr.im  m.inagt'iiimit  with 
hot  t or  Insight  Into  t ho  I r progr.ims  lo.ullng  to  bottor-rnn  programs  .u'oom- 
plisbo.l  In  .1  moi  o tliiu'ly  maniu'r , at  loss  risk,  .it  lowor  oost.  I'lio  t I'o  1 
li.is  oipi.il  ipp  1 io.it  ion  to  di-vo  lopiiuMit  progr.ims  .itid  to  roadliu'ss  progr.ims. 
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Decision  disk  Analysis  - AVSCOM  Manavo'i"cnt  Tool 
Mr.  I'au  1 H.  Sli.iplro 

US  Army  I'roop  Support  and  Aviation  Matin' iol  Keadiness  Oomma\id 


The  purpose  ot  this  presentation  is  to  inlorm  yon  ol  a now  mana);ement 
tracklnn  tool. 

Tlie  US  Army  Aviation  Systems  Command  (AVStH'M)  , and  the  US  Armv  Troo)-) 
Support  Command  (TKOSCilM),  botli  in  St.  houls,  have  been  reorg.inized  into 
two  new,  separate  commands,  the  US  Armv  i'roop  Support  and  Avi.it  ion  M.iter- 
lel  Readiness  Command  (TSARCtlM)  and  the  US  Army  Aviation  Research  .ind 
Development  Conmiand  (AVRADCCM)  , effective  1 .Inly  ld77. 

Tile  TSARCOM  Systems  Analysis  Office  (SAO)  is  presently  start  inp.  to  sup- 
port a Readiness  I’roject  Oft  ice  usinp  this  new  raanapement  tool.  Tlu' 
groundwork  of  the  management  tool,  however,  evolviwl  in  AVSCi'M  prior  to 
the  reorganization.  I'liis  inesent  at  ion  will  cover  t lie  Vv'ork  done  .it  AVSCi'M 

The  purpose  of  this  new  management  tool  is  to  supplv  decision  m.ikcrs  with 
a better  insight  into  their  programs,  either  in  summary  lonn,  or  in  .uiv 
desired  level  ol  detail.  This  tool  has  been  di'iuonst  rat  ed  in  the  .Adv.inced 
Attack  Helicopter  I'rogr.im  Management  01  lice  lA.AH  UNO),  which  is  pii'sonl  Iv 
In  development.  A recent  invest  ig.it  ion  showed  th.it  ap\iro\  imat  e Iv  tour 
times  as  much  money  is  present  Iv  being  spent  on  aviation  re.id  incss  t h.in 
is  being  spent  on  aviation  development.  fhis,  coupled  with  the  l.ict  that 
the  tool  is  .ipplicable  to  both  readiness  .ind  dovi' I opment  . led  to  the  opin 
ion  that  the  tool  should  be  even  more  useful  in  supporting  re.uiiness  pro- 
grams . 

Vuture  use  of  this  tool  should  contribute  to  better  programs  .iccomp  1 i shed 
in  a more  timely  manner,  at  less  cost.  below,  we  will  1 irsi  cx.imine  the 
background  of  the  tool  and  then  discuss  Decision  Risk  .Analvsis  tl'K.V)  . 

Analysis  has  evolved  within  the  Armv  .ind  changed  cons  ider.ih  1 v during  the 
past  ten  years.  Urogram  man.igers  and  office  heads  wi'ie  often  iii  tlu' 
position  of  having  to  make  timely  decisions  under  conditions  where  vevv 
little  information  was  available.  Decisions  were  ot  t en  m.ide  on  the  h.isis 
of  intuitive  judgments  with  person. il  feelings  pl.iving.  .i  s 1 g.n  i 1 i e.int  p.ii  t 
in  shaping  these  decisions. 

Small,  manually  manipul.ited  networks  evolved  with  the  intent  to  supplv 
decision  makers  with  more  inf  orm.it  i on , hut  thesi’  networks  h.id  limited 
capability,  or  only  looked  at  small  p.irts  ol  progr.iros,  or  ex.imined  \msI1v 
over-simplified  models  ot  those  pvogv.ims.  It  is  controversi.il  whether 
these  over-simplified  small  networks  di-l  more  h.irm  Ih.in  g.ood. 

With  the  popularization  of  the  use  ot  modern  computeis,  l.irge  networks 
came  into  use;  but  these  large  netwi-irks  tended  onlv  to  be  used  .it  m.ip'r 
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m I 1 1's  t inu'S  I'l  lai’ni'  proniams  lu'causi-  ol  t hi'  slow  paoi'  ol  ^t'lioi  a t i iij;  tlu' 
not  works,  nathorinn  tho  data  and  prodno  l\»>>  and  analyzing  tlio  answors.  It 
is  only  diuin>;  tho  last  voai  that  lai>;o,  anlomitod  notworks  havi'  hi-on  nsod 
that  aro  lloxihK'  to  rapid  ohan^os  in  lar^o  prognuiis.  Tlio  main  nsolnlnoss 
ot  thoso  lar.ni',  antomatod  notworks  is  tlio  oont  innons  snin'lv  ol  Inloimatlun 
to  dooisii'H  makors  ol  lar^;o  pro>;rams  durlnp.  t inios  ol  rapid,  major  ihanp,i's. 

Wo  will  iK'w  addri'ss  tho  mori'  rooont  \>ast  and  tho  ttoatinont  (>t  risk.  Ihil  i 1 
tho  last  voar  or  two,  tho  nnmhor  ot  i' i sk  .issossmont  stndii-s  tar  onl-woip,hod 
tho  nnmhor  ot  risk  analvsos.  Risk  ost  im.it  os  rosnltod  in  taps  ot  lliph, 

Mi'dinm  or  l.ow  risk.  lioo.insi’  ot  t hi'  laol  th.it  diltoiont  (>ropr.ims  o.in  .looopt 
dittoront  li'vols  ot  risk  and  .ilso  lu'o.inso  lliph,  Modinm  .ind  low  h.ivo  dillor- 
I'lit  I'lmnol  a t i oils  to  dllloront  pooplo,  risk  assossmonts  somot  iiiu's  lod  to 
d i t t i-ronoos  ot  opinion  on  wh.it  tho  rosnits  ot  tho  study  ro.illy  mo.int  . 

Risk  .in.ilysls,  with  its  atti-ndant  nnmorlo.il  I'stimatos,  lod  to  hottor  oom- 
mnnio.it  ion  I't  tlu-  n-snlts  ol  stiulios.  I’ooplo  nndorstoi.'d  th.it  ,i  10a.  i tsk 
iiii'.int  th.it  tho  oh. moo  was  ono  in  ti'ii  that  <i  propr.iiii  would  l.iil. 

DRA,  in  tho  l).\R0iiM  oommnnity,  has  slowly  bnt  snroly  ri'pl.iood  both  risk 
.inalysis  .iiul  risk  assi'ssmont  , oxoopt  in  .iro.is  snob  .is  portormanoi-  .inalysis. 
0R.\  is  .1  hiphly  strnotnri'd  mothod  that  is  soph  i s t i o.it  I'd  .ind  powortnl.  ORA 
is  oap.iblo  ot  ox.imininp  .i  vory  l.upo  propr.uii,  I'ssontially  withoni  any  loss 
ot  dot.iil,  pivon  t hi'  timo,  monoy  .iml  noooss.irv  dodio.iti'd  ottort.  I'ho  nsi" 
tnlni'ss  ot  DK.As  lias  now  inoroasi'ii  to  tho  point  wlu'ii'  .i  m.i  |or  Army  oontr.ioti'r 
h.is  roipiosti'd  nso  ot  this  Army  tool  to  traok  a m.ilor  Army  propram.  It  o.in 
truly  bo  s.ilil  th.it  rooont  Army  ol  torts  in  this  aroa  roprosont  tlio  st.ito  ot 
t hi'  ar  t . 

boloro  ilisonssinp  I'RA  itsi'll,  most  ri'oont  AVSIX'M  ORAs  will  bo  briot  ly  dls- 
onssoil.  In  Id/S,  liRAs  still  nii>stly  iisod  sm.i  1 1 notworks  .ind  woro  only  sfio- 
radio.illy  oxoroisod.  I'lio  iii.ijor  bKA  in  ld7S  was  .in  I'xamin.it  ion  ot  a l.irpo 
niimbor  ol  sm.ill  propr.ims  boinp  sot  np  by  tbi'  Airor.it  t Snrv  iy.ib  i 1 1 1 y iquip- 
niont  I'ropi  .till  M.in.ipi'r  iASK  I’M).  By  mid-ld7b,  ,'\VS(.I0M  h.id  movod  on  to  l.upo 
I'RA  notworks.  Ihoso  notworks  woro  bi'inp  nsi'd  lor  maior  milostonos  only. 

.An  ox.implo  ol  this  is  .i  notwork  oontaininp  11/  .iros  and  nodi's  nsi'd  in  sup- 
port ol  tho  AAll  I’M  I'ovolopmont  I'.onoopt  I’.ipor  tlA'l’)  . I'ho  AAH  I’M  was  \'hasinp 
into  .iilv.iiu'oil  ili'Vi' 1 opiiion  t , .iiul  as  .i  rosnlt  ot  somo  major  tnndinp  oonst  i .i  1 nt  s , 

had  to  I'xamitu'  oipht  m.ijor  propr.iiii  options  in  dotail.  .A  rosnlt  ol  tho  noo- 

ossitv  to  r.ipidly  aooommoilat  i'  now  intorm.it  ion  .ind  roport  tho  main  rosults 

to  tho  I’M  with  t urn-. i round  t imos  .is  short  as  7't  hours  in  somi'  o.isos,  lorood 

antoni. Ill'll  prooi'ssinp  ol  lU'w  1 iil  orm.it  ion  , .ind  r.ipid  mod  1 1 1 1 .it  i on  ot  l.irpo 
oxist  inp  I'ropr.ims.  Both  analysis  ot  tho  rosults  .ind  vorit  io.il  ion  ol  not- 
work .ii'onr.ioy  liad  to  bo  .u'oomp  1 i shod  in  .in  oxt  romo  ly  short  timo. 

h.irpo  I'R.A  propr.ims  h i st  or  i o.i  1 ly  had  I urn-.iroiind  t imos  th.it  t.iiipod  t rom  throo 
to  tour  months.  Whon  support  ot  tho  .AAll  I'M  si.irtod,  initi.il  propram  sot  up 
.ind  t nrn-.irinnid  t iiiu'  ol  wh.it  tnrnod  out  to  In'  t'pt  ion  1,  w.is  U'  d.iys.  rurn- 
.iround  timo  lU'oro.isi'd  as  lurtlu'r  options  h.ul  to  bo  lookod  .it. 


Several  thln>;s  wore  necessary  for  the  type  of  operat ton  discussed  above. 
These  were:  24  hour  a day,  7 days  a week  availability  of  an  1 HM  3hO-b5 
computer,  hl>;h  computer  priority,  availability  of  technical  people  that 
did  not  have  to  be  trained  durinj;  the  exercise,  availability  of  necessarv 
technical  personnel  wtien  needed,  and  sufficient  funding  for  necessary 
overt ime . 

The  team  conducting  the  DRA  itself  never  exceeded  three  people.  Acci'ss, 
however,  to  people  In  tlie  AAH  I’MO,  to  people  at  the  AAH  Source  Selection 
Kvaluation  Board  (SSEB)  , and  to  people  In  otlier  I’Ms  such  as  Mil  If  ire,  and 
various  experts  in  the  Army,  had  to  he  assured  through  the  support  ol  the 
/Vt\H  PMO. 

The  above  rapid  response  to  many  alternatives  demonstrated  that  DRA  is 
capable  of  continually  tracking  a large  program  undergoing  routine  changi'S. 
This  in  turn  led  to  an  expressed  desire  by  AAH  I’M  personnel  that  the  Sys- 
tems Analysis  Office  (SAO)  set  up  continual  tracking  of  their  progr;un.  In 
addition,  a major  change  was  also  requested:  the  DRA  used  for  continual 
tracking  should  have  schedule,  cost  and  performance  incorporated  into  one 
network.  In  the  past,  with  the  exception  of  work  done  in  Rock  Island  by 
Mr.  Oerald  Moeller  and  associates,  cost  and  schedule  have  been  separately 
tracked.  In  addition  to  separate  tracking  of  cost  and  schedule,  the  work 
has  usually  been  performed  by  separate  offices. 

Hughes  Helicopter  is  the  prime  contractor  for  the  AAH.  The  program  manager 
at  Hughes  has  requested  that  the  AiMl  DRA  model  be  made  available  to  him  so 
that  Hughes  can  Insert  their  owri  estimates  of  risk  into  the  model  and  use 
the  results  to  discuss  the  program  with  Army  personnel. 

We  will  now  discuss  DRA  itself.  DRA  is  a mature,  proven  tool  throughout 
the  DARlXlM  community.  This  tool  is  now  being  put  to  a new  management  use: 
continuing  management  visibility  into  on-going  programs. 

DRAs  can  supply  Information  connected  with  two  management  functions: 
planning  and  control.  Because  of  the  nature  of  DRA,  planning  can  be  done 
f.ir  in  advance  of  specific  events.  Interrelationships  of  various  activi- 
ties can  be  studied.  Older  computer  programs  utilized  several  parallel 
sequences  of  events  to  simulate  pri'grams.  Our  DRAs  are  networks:  a change 
in  one  event  can  attect  manv  other  events  In  a network.  In  addition,  we 
are  using  .i  specific  computer  program,  VERT,  that  is  capable  of  simultan- 
eouslv  processing  cost,  time  and  pertormance  information.  Considering 
cost,  time  .ind  pertormance:  each  characteristic  can  be  made  to  drive 
either  or  ho.h  ot  the  other  characteristics.  There  are  other  computer 
progr.tm.s  th.it  look  at  cost,  time,  and  possibly  performance,  but  these 
char.icter  I St  ics  .ire  processed  in  series.  One  usually  cannot  drive  the 
other. 

Any  part  of  the  VERT  network  can  be  expanded  to  essentially  anv  desired 
detail  in  order  to  focus  on  critical  events.  Alternatives  can  be  explored 
either  in  series  or  parallel.  Iter.itive  use  of  .i  network  can  be  used  to 
establish  priorities  of  management  attention. 
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In  tin.’  I’ontiol  .uea  ol  iiumum'mout  : porlodii’  ri-viow  ami  iipdato  ol  pro^r;uns 
i-an  fini  tai'o  tronds  tliat  tond  to  f la>;  hot  t U’liocks  in  tin-  pro^trani.  As  an 
oxamplo,  it  It  Is  t i>iind  that  a small  chanso  in  an  ostimatod  valno  chanm“s 
t ho  orltioal  patli  tinxii  ono  sorios  v't  ovi’iits  to  anotlu’r,  a hidden  hottlo- 
nook  may  snrtaoo  and  ho  ahlo  to  ho  t lagged  tor  managomont  attention  as  a 
potential  trouhlo  spot.  I’ariUiiot  r to  or  sonstivlty  analysis  oan  alsi'  load 
to  improvements  ol  a progr.un  without  having  to  go  through  major  pri'gram 
ehanges . 

ihe  Armv  has  used  a number  ol  computer  provtrams  to  lmpli*ment  l)K.-\.  (liMtiputer 
progr.uus  n.ive  become  more  vers.itile  and  powertul  with  time.  The  computer 
progr.un  in  invest  conunon  use  in  the  Army  today.  Venture  Kv.iluation  .tnd  Review 
I'echnique  (VKR'i')  , represents  the  state  ol  the  art  both  in  the  Armv  and  in 
iiulustry.  Vt'.Rr  was  vieveioped  by  Mr.  tler.ild  Moeller  ot  .\RRtXlM.  This  model 
is  being  used  in  a way  that  it  is  intended  lor:  communication  ot  results 
and  reciMnmend.it  ions  to  decision  maki-rs.  What  is  new  is  that  the  model  is 
being  usid  to  continually  track  the  status  ol  major  progr.ims  instead  ot  ■ 
being  used  on  a very  infrequent  basis. 

i- 

Conducting  a DRA  c l.iss  ic.i  1 1 y includes  six  m.iin  functions.  The  six  functions 

are:  1.)  Dt’fining  the  vdyjective  of  the  MRA,  2.)  Development  ot  a network,  '• 

l. )  Obt. lining  input  to  the  network,  4.)  Running  the  computer  pri'gr;uii, 

“S.!  .Analyzing  the  output,  .ind  b.)  Communic.it  ion  with  the  decision  makers  on 
the  pt'ogr.im. 

I'he  objective  of  .i  DR.\  m.iy  be  obvious  or  m.iv  t.ike  ci'ns i der.ib  1 e discussion  » 

with  various  levels  ol  management  and  working  levels  in  the  oil  ice  being 

supported.  After  the  I'bjective  h.is  been  defined,  a network  is  developed.  I 

This  network  must  lu'  an  .idequ.ite  m<Hle  1 of  the  progr.im,  problem  I'r  specific  i j 

situ.it  ion  being  ex.imined.  It  is  usu.illy  necessarv  to  ciMiimunlcate  what  the  j 

network  represents  with  wi>rking  level  peoplt'  in  the  olfice  bi-ing  supported.  j 

I'he  third  step  in  .i  DR.A  is  the  most  critical.  The  limit.it  ii'n  ol  accuracv 
ot  a 1)R.A  resides  in  t’lie  accur.icy  ot  the  input  numbers  to  the  network  it- 
self. riiis  input  dat.i  m.iy  be  i>bt. lined  from  the  office  bi'ing  supinirteil  or 

m. iy  be  obt.iined  p.irtially  or  wholly  1 rom  people  outside  the  olfice, 
iHit.siile  the  conunaiid,  i>r  evi’ti  outside  t lu’  Armv,  liepeiuU’iit  upon  tlu'  rule.s 
established  as  part  ot  defining  the  objective  of  the  DRA.  I'he  next  step, 

running  of  the  computer  progr.im,  is  the  most  routine  step.  j 

j 

Analvsts  running  the  prognuii  analyze  the  output  in  detail.  I'his  .in.ilvsis  ■ 

h.is  two  objectives  .ind  results:  I . '1  Ver  i f ii-.it  ion  that  the  network  is  | 

error-tree,  .ind  2.)  Dnderst  anil  i ng  I'.ich  result  .it  each  point  in  the  network.  , 

Ihe  l.ist  step  is  reducing  ol  the  signiticant  dat.i  .ind  communtc.it  ion  of  j 

results  to  working  level  personnel,  and  then  to  decision  makers. 

lilt  result.s  m.iv  be  in  extreme  summ.iry  linm  such  a.s  one  gr.iph  or  listing,  or  : 

m.iy  be  in  great  det.iil,  explaining  results,  re.isons  lor  e.ich  result,  .ind 

m.issive  b.ick-up  di'cument.it  ion.  ^ 

Ihe  six  step.',  .ibiive  were  discussed  .is  il  tlu'v  h.ippt'ii  in  series.  I'he  nor-  j 

ma  I t'ccur  fence , howevi-r,  is  that  most  til  the  steps  .ire  iti’r.itive.  Results  | 
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of  a DRA  usually  lead  to  efforts  by  personnel  in  the  office  being  supported 
to  either  improve  the  progr;un  or  examine  a specific  area  of  the  progriim. 

The  network  is  accordingly  modified;  results  are  obtained,  analyzed  and 
communicated. 

A worthwhile  DRA  depends  upon  constant  communication  between  the  analysts 
conducting  the  DRA  and  the  customer.  Looking  at  some  of  the  tasks  in  an 
iterative  manner  leads  to  better,  more  realistic  input  and  more  .nsiglit 
into  the  program  itself,  possibly  leading  to  changes  in  the  program. 

Communication  of  DRA  results  has  matured  in  AVSCOM.  In-depth  analysis  of 
computer  runs  results  in  verified  accuracy  of  the  output,  better  under- 
standing of  the  output,  and  sometimes  identification  of  subtle  problem 
areas  tliat  were  previously  unknown.  DRAs  are  now  reported  in  two  pliases : 
fast  reaction,  summarized  output  followed  by  full  documentation  of  the  DRA. 

Full  documentation  gives  complete  traceability  of  the  network  itself  and 
the  input  to  the  network.  All  input  data  is  identified  by  source  or  sources 
and  by  date  or  dates  obtained.  Any  future  questions  on  the  DRA  by  tlio 
Commitnd  itself,  by  DARCOM,  DA  or  DOD,  can  be  fully  answered  because  of  this 
complete  traceability. 

In  conclusion,  it  is  felt  that  DRAs  presently  contribute  to  better  manage- 
ment insight.  This  "better  insight"  should  contribute  to  better-run  pro- 
grams, run  in  a more  timely  manner,  with  less  risk,  at  less  cost. 
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ABSTRACT : A methodology  has  been  developed  which  can  ascribe  theater- 

Tevel  support  requirements  to  individual  major  weapons  in  the  combat 
elements  of  a theater  force.  The  methodology  uses  the  FASTALS  Model  to 
roundout  a base  case  combat  force.  Then,  by  deletion  of  the  weapons  cate- 
gory of  interest  and  its  directly  associated  personnel  and  equipment,  a 
reduced  troop  list  is  produced  by  FASTALS.  The  difference  in  troop  lists 
is,  for  example,  the  "tank"  slice.  A method  has  been  developed  to  permit 
definition  not  only  of  the  tank  slice  but  of  an  "XMl"  slice.  The  slice 
methodology  provided  the  incremental  data  used  for  the  force  structuring 
mathematical  programing  in  the  CONAF  IV,  CONAF  V,  and  TRANSFORM  studies. 

The  TR/ANSFORM  application  using  goal  programing  is  presented  in  another 
paper  of  these  Proceedings:  "The  Use  of  Goal  Programing  in  the  Theater 
Level  Design  of  Forces,"  by  CCL  Robert  E.  Robinson  and  LTC  Edward  E, 
Hildreth,  Jr.  The  general  methodology  has  been  applied  to  determination 
of  the  shipping  weight  of  a single  weapon  and  its  total  required  support. 

A costing  methodology  provides  recurring  and  nonrecurring  cost  coefficients 
and  constraints.  The  slice  approach  also  has  potential  real  world  applica- 
tions such  as  estimating  the  gross  personnel  effects  of  adding  a helicopter 
company  to  Seventh  Army  or  of  converting  an  infantry  battalion  to  a tank 
battal ion. 


SUBJECT:  Weapon  Slices — An  Incranental  Approach  to  Force  Design 

AUTHOR:  Mr.  Robert  C.  Spiker 

AGENCY:  US  Army  Concepts  Analysis  Agency 

INTRODUCTION 

A weapons  slice,  what  is  it?  Until  about  two  and  a half  years  ago  the 
terms  "weapon  slice*  and  "system  slice"  were  not  a part  of  the  force  de- 
signer's vocabulary.  Until  that  time  he  had  known  a model  called  the 
battalion  slice;  he  had  described  forces  in  terms  of  division  slices. 

The  weapon  slice,  however,  would  permit  a new  incremental  approach  to  the 
aesign  of  forces.  An  application  of  the  weapon  slice  methodology  in  a 
force  structuring  study  is  presented  elsewhere  in  the  Proceedings  in  a 
paper  entitled:  “The  Use  of  Goal  Programing  in  the  Theater  Level  Design 
of  Forces,"  by  COL  Robert  E.  Robinson  and  LTC  Edward  E.  Hildreth,  Jr. 

BACKGROUND 

The  CONAF  series  of  studies  (CONAF  is  the  acronym  for  Conceptual  De- 
sign for  the  Army  in  the  Field)  have  considered  conceptual  designs  for 
the  division  forces  as  part  of  a US  Theater  Army  operating  in  the  central 
region  of  NATO  in  the  far  midrange  time  frame  (about  12  years  after  the 
study  period). 

In  CONAF  IV,  the  methodology  for  conceptual  force  design  was  expanded 
to  use  a systems  approach.  Major  materiel  systems  such  as  tanks  were 
considered  the  force  design  variables.  System  slices  were  developed  to 
include’  all  combat  personnel,  support  personnel  and  workloads  that  were 
associated  with  the  changing  size  of  a given  materiel  system.  For  a for- 
mal definition  of  the  system  slice  the  following  will  serve: 

A system  slice  is  a weapon  category  in  a force,  defined  in 
terms  of  all  combat  and  support  personnel,  equipment  and  costs 
associated  with  the  weapon  category  directly  and  indirectly 
which  enable  the  slice  weapons--and  only  those  weapons— to 
function  in  combat. 

A weapon  slice  is  similarly  defined  except  that  the  above  qualifying 
terms  are  applied  to  a single  weapon  type,  "the  XMl  slice,"  rather  than 
to  a group  of  like  weapons.  An  individual  weapon  slice,  the  slice  asso- 
ciated with  a single  XMl  tank,  is  simply  the  weapon  slice  divided  by  the 
number  of  weapons  in  it.  Before  d’*scussing  the  methodology  of  calculat- 
ing weapons  slices  or  examining  the  data  that  is  obtained  using  this 
methodology,  let  us  address  the  uses  to  which  slices  have  been  put. 

a.  In  CONAF  IV  system  slices  we'^e  calculated  wtiich  included  the  total 
number  of  weapons  of  a given  type,  for  instance  all  the  tanks  or  all 
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the  artillery  pieces.  These  system  slices  were  used  to  calculate  the 
coefficients  ana  constraints  wtiich  were  used  in  the  CUf4AF  IV  linear  pro- 
gram methodology.  For  CONAF  IV  the  approach  was  limited  Dy  the  newness 
of  the  tool  and  the  lack  of  understanding  of  the  total  capaoilities  inhe- 
rent in  slice  methodology.  Only  six  slices  were  defined:  a tank  slice, 
an  armored  personnel  carrier  (AFC)  slice,  an  artillery  slice,  a heli- 
copter slice,  a mortar  slice,  and  an  antitank  guided  missile  slice.  The 
theater  population  included  in  these  six  slices  was  only  40  percent  of 
the  total  theater  strength.  The  retnainder  of  the  theater  was  considered 
to  be  in  a residual  slice  which  was  not  useful  for  force  design  purposes. 

b.  The  CONAF  V study  was  directed  at  answering  the  question,  "What 
can  be  varied  to  change  the  productivity  of  the  force  within  resource 
constraints?"  The  most  desirable  approach  would  have  included  a capabil- 
ity to  trade  individual  weapons  for  other  weapons  of  the  same  type;  e.g., 
to  trade  10  new  type  tanks  for  4u  older  but  product  improved  tanks. 

CONAF  IV  could  not  do  this  since  there  was  no  way  of  differentiating  the 
productivities  of  two  different  weapons  which  existed  in  the  same  system 
slice.  CONAF  V could  not  do  this  either.  Progress  was  made,  however,  in 
developing  the  slice  methodology  in  CONAF  V.  The  number  of  slices  was 
increased  by  two.  An  infantry  slice  was  defined  and  an  APC  mounted  TOW 
slice  was  manually  separated  from  the  overall  APC  slice.  This  was  the 
beginning  of  the  development  of  individual  weapon  slices.  In  addition,  a 
methodology  for  defining  separately  Active  and  Reserve  Component  slices 
was  developed.  Costing  procedures  were  improved  so  that  costs  of  the 
Active  and  the  Reserve  Component  slices  for  each  system  would  reflect  the 
differences  in  costs  of  the  Active  and  Reserve  forces.  Through  improved 
slicing  techniques  and  the  definition  of  the  infantry  slice,  the  residual 
slice  was  reduced  to  35  percent  of  the  total  theater  force. 

c.  For  tne  TRANSFORM  (Trade-Off  Analysis  Systems/Force  Mix)  Study,* 
the  weapon  slice  methodology  was  developed  and  refined  so  that  the  use  of 
individual  weapon  slices  was  possible.  In  addition,  a nonweapons  system 
slice,  the  Theater  Level  Support  slice,  was  defined  to  include  those  per- 
sonnel whose  presence  in  theater  is  independent  of  the  size  of  any  weapon 
system,  i.e.,  those  personnel  such  as  tneater  headquarters  personnel  who 
are  there  simply  because  the  theater  is  tnere.  An  air  defense  systems 
slice  was  defined  for  TRANSFORM  but  it  was  "fenced"  and  its  resources 
were  not  made  available  to  the  force  design  program.  The  costing  metho- 
dology was  further  improved  to  provide  not  only  recurring  and  nonrecur- 
ring costs  separately,  but  also  to  provide  two  separate  types  of  nonre- 
curring costs,  modernization  and  activation.  Base  level  or  modernization 
costs  refer  to  the  estimated  costs  to  achieve  slice  or  force  moderniza- 
tion by  the  base  design  year  through  currently  planned  equipment  modern- 
ization or  replacement;  activation  costs  reflect  the  estimated  cost  to 
purchase  newly  activated  slices  or  fractions  thereof  which  are  in  excess 
of  currently  programed  levels. 


‘TRANSFORM  app! icd  the  slice  methodology  and  mathematical  (goal)  pro- 
graming to  evaluate  the  Uivision  Restructuring  Study  (JRS)  heavy  division 
and  the  Aviation  Keguircments  for  the  Combat  Structure  of  the  Army  111 
(ARCSA  111)  Study. 
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d.  The  development  of  the  weapon  slice  methodology  and  the  concurrent 
improvements  in  slicing  and  costing  techniques  aadea  new  mathematical 
perspectives  to  the  art  of  force  design  in  the  CONAF  and  TRANSFORM 
studies.  The  individual  weapon  slice  is  indeed  available  as  a tool  for 
the  incremental  design  of  forces  and  for  many  other  applications  only  now 
beginning  to  be  investigated. 

DERIVATION  OF  SYSTEM  SLICES 

The  exact  size  and  other  attributes  of  any  slice  will  vary  somewhat 
depending  upon  the  base  case  from  which  the  slice  is  extracted.  Even 
using  the  same  base  case  force  the  slice  size  will  vary  depending  upon 
the  time  during  the  deployment  of  the  force  that  the  slice  is  defined, 
constraints  that  may  be  in  effect  at  the  chosen  time,  maturity  of  the 
theater,  and  other  variables.  Slices  may  be  subdivided,  as  was  done  for 
transform,  into  Active  and  Reserve  Component  slices.  M-day  and  D-day 
slices  may  be  calculated.  Slice  weights  may  be  determined  and  analyzed 
in  tenns  of  the  associated  strategic  lift  required.  Supply  consumption  or 
maintenance  requirements  may  be  evaluated.  These  and  other  quantities 
may  oe  developed  using  the  methodology  and  presented  in  any  format  that 
is  useful  to  the  force  designer. 

The  first  step  in  developing  the  system  slices  is  to  count  the  numbers 
of  each  type  of  weapon  authorized  the  base  case  force  at  any  time  period 
of  concern.  This  requires  some  military  judgement  to  identify  those  wea- 
pons which  contribute  to  the  firepower  potential  of  the  force  under  nor- 
mal combat  conditions.  For  example,  while  most  ARC  have  some  armament, 
many  are  used  for  maintenance  tasks  in  Armor  units  or  in  Engineer  units 
and  normally  do  not  engage  in  combat;  these  should  not  be  included  in  the 
slice  weapon  count.  Next  the  individual  weapon  types  are  grouped  into 
weapon  systems  which  are  convenient  for  handling  in  the  Force  Analysis 
Simulation  of  Theater  Aumini strati ve  and  Logistics  Support  (FASTALS)  Mo- 
del and  which  will  secure  a proportionate  share  of  command,  control  and 
support  personnel  through  normal  functioning  of  the  model.  FASTALS 
rounds  out  an  input  comoat  troop  list  througn  development  of  associated 
work  loads  and  application  of  appropriate  allocation  rules  to  provide  a 
balanced  troop  list  which  includes  all  units  in  the  theater. 

For  TRANSFORM  the  Active  and  Reserve  Component  system  slice  weapons 
categories  and  the  numbers  of  individual  weapons  types  in  each  are  shown 
in  Table  1.  A major  difference  between  this  list  and  the  systems  slices 
used  in  CONAF  V is  the  definition  of  the  lightly  armored  tracked  vehicle 
(LATV)  slice.  The  LATV  slice  contains  the  infantry  fighting  vehicle/ca- 
valry fighting  vehicle  (IFV/CFV),  formerly  the  NICV/TbAT;  the  improved 
TOW  vehicle  (ITV);  the  armored  reconnai ssance  airborne  assault  vehicle, 
(ARAAV),  the  MbSl,  SHERIDAN;  and  the  annored  personnel  carrier  (ARC), 
MllJAl.  As  will  oe  seen  later,  the  ARC  was  treated  as  an  individual  wea- 
pon slice  in  TRANSFORM  and  tne  other  weapons  in  this  slice  were  grouped 
together  in  a composite  slice  called  the  light  antitank  tracked  vehicle 
(LATIV)  slice. 


Table  1 


Weapons  and  Weapon  Systems 


Nii-hers  of  weai'ons 

Weapon  type 

Active  units 

Kt'serve  units  j 

Total 

Tanks 

XMl 

1.773 

u 

1,773 

KbUA2 

37a 

0 

378 

MbUA3 

1,493 

2,087 

3,580 

Lightly  Armored 

Tracked  Vehicles  (LATV) 

Improved  TOW  Vehicle  (ITV)  1,996 

1,116 

3,112 

IFV/CFV^ 

1,677 

0 

1,677 

M5bl  Sheridan 

933 

207 

1,140 

M113A1  APC 

4,411 

3,220 

7,631 

Arti  1 lery 

XM  2U4-1U5T 

126 

378 

504 

X^l  19tJ-lSbT 

288 

414 

702 

M1U9A1-155SP 

870 

474 

1,344 

M110E2-6-1n  SP 

412 

320 

732 

Antitank  Guided 

Missiles  (ATOM) 

TOW  (ground  mount) 

384 

1,062 

1.446 

DRAGON 

4,159 

3,333 

7,492 

Helicopters 

AAH 

234 

0 

234 

AH  1 0/S 

185 

270 

455 

AHIG 

157 

165 

322 

Mortars 

81mtn 

666 

270 

936 

107mm 

799 

644 

1.443 

Light  Weight  Company 

Mortar  (LWCM) 

192 

531 

723 

Air  Defense 

Nike  Hercules 

96 

0 

96 

HAWK 

330 

0 

330 

CHAPARREL 

360 

192 

552 

VULCAN 

408 

192 

600 

REDEYE 

1,542 

1,264 

2,806 

Infantry 

Infantry  individual  weapons  25,929 

30,252 

E6,181 

Changes  dtstnbuted  by  CDCSOPS  on  2 
MICV/T‘:AT  II  (TOW  BUSK'^.ASTER  AP^-.-.EO  TeSRET) 
Vehicle  llEV),  and  MlCV/Scojt  (also  TBAT)  to 
(CFV). 


June  1977  changed: 
to  Infantry  F Ighting 
Cavalry  Fighting  Vehicle 


Tne  division  of  the  weapons  and  weapon  systems  into  Active  and  Reserve 
Component  parts  was  based  on  the  following  logic.  Active  Army  and  Re- 
serve Component  (RC)  units  differ  particularly  in  two  important  attri- 
butes— readiness  and  costs.  In  TRANSFORM,  the  Transportation  Model 
(TRANSMO)  was  able  to  deliver  most  Active  Army  combat  units  and  a few  RC 
brigades  by  L)+34.  The  first  RC  division  dio  not  arrive  until  D+56.  Ihis 
provided  a clear  break-point  in  the  FASTALS  roundout  for  definition  of 
the  Active  slice  and  the  Reserve  slice.  In  the  FASTALS  roundout,  all 
units  and  equipment  arriving  and  all  workloads  generated  before  D+39  (the 
end  of  the  6th  FASTALS  time  period)  were  considered  part  of  the  Active 
slice;  everything  thereafter,  part  of  the  Reserve  slice.  It  is  recogn- 
ized that  more  Reserve  units,  particularly  service  support  companies  and 
battalions,  were  counted  as  part  of  the  Active  si  ice  than  vice  versa.  It 
would  have  been  impossible  to  identify  these  units  at  unit  identification 
code  (Die)  level  in  TRANSFORM,  but  using  the  40th  day  dividing  line  gave 
a surprisingly  good  representation  of  the  real  world  division  of  the  Ac- 
tive Amy  - Reserve  Component  strengths.  In  TRANSFORM,  58  percent  of  the 
force  was  counted  as  Active  Army;  if  based  on  present  force  composition, 
it  might  have  been  closer  to  45  percent  for  a 90-day  war. 

The  system  slice  approach  envisions  treating  the  whole  slice  as  a 
variable  of  design.  Development  of  the  system  slices  in  TRANSFORM 
started  with  the  weapons  as  shown  in  Table  1.  The  next  step  in  defining 
each  system  slice  was  to  determine  the  logistic  roundout  associated  with 
the  slice.  To  do  this  the  complete  combat  portion  of  the  base  case  was 
identified,  and  its  combat  activity  in  an  appropriate  scenario  was  deter- 
mined by  CEM.  CEH  output  such  as  combat  activity  were  input  to  the  FAS- 
TALS Model.  This  simulation  computed  workloads  based  on  anticipated  in- 
tensity of  combat  together  with  the  buildup  of  the  force  over  time.  Lo- 
gistic support  units  and  personnel  were  developed  as  a product  of  these 
computations.  From  this  process  the  total  force  for  the  TRANSFORM  base 
case  was  defined. 

To  identify  the  system  slice  components  of  that  total  force  a simple 
artifice  was  employed.  All  of  the  previously  identified  combat  systems 
were  removed  for  each  slice  one  at  a time.  The  net  combat  force  was  then 
input  to  the  FASTALS  model.  The  resulting  roundout  force  had  a lower 
combat  population  than  the  base  case,  had  less  workload  involved  and 
therefore  less  support  units.  For  each  slice  case  and  for  the  base  case 
the  total  force  populations  and  costs  were  computed.  The  omitted  slice 
results  were  compared  with  the  base  case  results.  The  differences  were 
attributed  to  and  related  to  the  system  slice.  It  is  assumed  that  as  the 
slice  size  changes  the  derived  workload  demand,  population  and  cost  will 
change  proportionately.  The  TRANSFORM  base  case  differed  little  from 
tne  CONAF  V base  case  in  some  weapon  ^ystems--hel icopters , mortars,  and 
i nfantry--and  these  CONAF  V system  slices  were  used  for  TRANSFORM. 

As  noted  earlier  in  defining,  the  system  slices,  it  i?  not  possible  to 
associate  all  of  the  personnel  and  units  in  the  theater  with  one  and  only 
one  of  the  weapons  systems.  Some  units,  such  as  division  headquarters, 
are  there  to  command  all  the  weapons  systems  in  the  division  and  cannot 
function  as  a partial  unit.  Other  units,  the  theater  headquarters,  tor 
example,  are  there  because  the  theater  is  there  and  have  no  relationship 
with  the  size  or  a particular  weapons  system.  The  functions  of  some 
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units  and  personnel  are  not  very  sharply  defined  and,  for  TRAIISFURM, 
these  personnel  were  allowed  to  reriain  in  the  unassigned  or  variable  re- 
sidual slice.  Nevertheless,  tne  residual  slice  was  reduced  to  only  Id. fa 
percent  of  the  force.  It  is  expected  in  the  future  to  reduce  this  fur- 
ther or,  as  a minimun,  to  make  some  part, of  it  available  to  the  force 
design  process. 


DERIVATION  OF  WEAPON  SLICES 

FASTALS  is  both  a necessary  and  sufficient  model  in  the  slice  metho- 
dology for  development  of  system  slices,  but  certain  model  characteris- 
tics make  it  less  than  satisfactory  for  direct  calculation  of  most  weapon 
slices.  The  model  logic  does  not  readily  permit  description  of  very 
small  slices.  FASTALS  only  assigns  wnole  units  which  implies,  therefore, 
the  use  of  rounding  rules  (round  up,  round  down,  or  round  up  over  U.5). 
Moving  just  across  one  of  the  rounding  steps  can  cause  a considerable 
distortion  in  the  troop  list  for  a small  slice.  A second  major  problem 
in  using  FASTALS  directly  for  calculation  of  the  large  number  of  possible 
individual  weapon  slices  is  the  workload  associated  with  the  preparation 
of  the  input  data  for  each  FASTALS  simulation.  As  a minimum,  manually 
input  and  D-day  units  must  be  adjusted,  divisional  and  brigade  strengths 
must  be  changed,  and  POMCUS  recalculated  for  the  scenario.  For  the  mas- 
terfile,  unit  strengths,  weights  and  requirements  for  automotive  and  air- 
craft maintenance  must  be  calculated  and  entered,  allocation  rules 
changed,  and  rounding  rules  adjusted  if  necessary. 

Personnel  strengths  and  constraints  are  a major  concern  in  any  force 
design  project.  At  the  individual  weapon  level  of  force  design,  develop- 
ment of  individual  weapon  personnel  slices  is  a requirement.  FASTALS  is 
used  to  determine  the  personnel  values  for  fairly  large  composite  slices 
of  closely  related  weapons,  the  system  slices.  These  system  slices  are 
then  divided  into  individual  weapon  slices  based  on  known  direct  person- 
nel requirements  peculiar  to  the  weapon.  The  remaining  personnel  in  the 
system  slice  are  allocated  among  the  weapon  slices  on  the  basis  of  num- 
bers of  weapons  or  some  similar  basis  for  dividing  these  indirectly  asso- 
ciated personnel.  In  this  manner  each  individual  weapon  slice  receives  a 
fair  proportion  of  command  and  control  personnel,  corps  engineers,  termi- 
nal service  company  support  and  other  indirect  supporting  personnel.  For 
TRANSFORM,  this  methodology  was  applied  to  system  slices  calculated  at 
several  specific  times  during  the  FASTALS  simulation.  The  Active  Army  and 
Reserve  Components  (RC)  weapon  slices  were  calculated  from  system  slices 
derived  for  D+39  and  the  end  of  the  simulation.  Table  2 lists  the  Active 
Army,  RC,  and  end-of-war  or  doctrinal ly  supported  personnel  slices  for 
each  system,  weapon  type  and  individual  weapon  in  TRANSFORM. 

a.  All  slices  reflect  some  of  the  characteristics  of  the  base  case 
from  which  they  were  developed.  In  general  the  slice  for  a RC  weapon  is 
slightly  larger  than  the  slice  for  an  Active  weapon.  This  is  true  because 
the  arrival  of  many  of  the  lower  priority  units  for  a fully  supported 
theater  are  deferred  until  late  in  the  simulation.  As  an  exception.  Ac- 
tive attack  helicopter  slices  are  larger  than  reserve  slices  because  of 
the  large  numbers  of  assault- type  helicopters  and  supporting  personnel  in 
the  Active  slice. 
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b.  Not  all  of  the  Individual  weapon  slice  coefficients  were  used  in 
the  TRANSFORM  goal  programs.  One  that  was  of  particular  value  for  the 
Division  Restructuring  Study  (DRS)  force  design  was  the  light  antitank 
tracked  vehicle  (LATTV)  slice.  This  was  not  an  individual  weapon  slice 
but  rather  a composite  of  three  individual  weapons  - the  IFV/CFV,  the 
ITV,  and  the  M551  light  tank.  It  illustrates  the  powerful  tool  available 
in  individual  weapons  slices  which  allows  synthesis  of  composite  slices 
at  the  convenience  of  the  force  designer. 


Table  2.  Individual  Weapon  Slice  Personnel  Coefficients 
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1.617 
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17.761 

9.S25 
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Iw.Svo 

ITt 

1 .vvo 

l.lle 
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14. te? 

32.9ie 

9.S2S 

ii.y 

lw.S9o 

4. til 

l,22u 

7.e3: 

3a.*”s 

6S,SS7 

7.9.-S 

1./.  *v7 

e.S 

■ssi 

yji 

a-7 
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10.75? 
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14.3S4 

1KS2S 

14.70) 

12.S90 

total  or 

average 

9,u|7 

4.S4J 

23.S»v 

’e.9?7 

Sl.7b4 

130.631 

8.793 

11.3ol 

9.034 

lATIv 

4. out 

1.323 

S.v?* 

45,730 

17.220 

6S.074 

9.930 

13.020 

10.972 
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Mil}) 
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IM  \ 

I.T7J 

0 

2.773 

29,312 

0 

29.603 

10.S33 

0 

26.8$4 
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370 

u 
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0 
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16.S33 

0 
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Force  cost  is  probably  the  second  most  severe  constraint  on  force  de- 
sign--after  force  manpower.  In  many  cases,  available  monetary  resources 
may  oe  even  more  important  than  available  manpower  in  determining  not 
only  the  size  but  also  the  type  of  force  which  can  be  supported.  The 
slice  methodology  adapts  nicely  to  the  introduction  of  cost  constraints 
into  the  force  design  process. 

a.  TRANSFORM  introduced  three  significant  improvements  in  slice  cost- 
ing procedures  - separation  of  nonrecurring  and  recurring  costs,  the  di- 
vision of  nonrecurring  costs  into  modernization  and  activation  costs,  and 
the  calculation  of  slice  costs  for  individual  weapons.  Recurring  costs 
(RC)  are  a positive  cash  flow  indicator  and  are  part  of  the  affordability 
evaluation  for  any  force  design.  Modernization  or  base  level  costs,  low 
nonrecurring  costs  (NRC  Lo),  are  the  presently  planned  expenditures  for 
major  items  of  new  or  modernization  equipment  which  are  reflected  in  the 
projection  and  modernization  of  the  Army  from  the  base  year  to  the  design 
year.  Activation  costs,  high  nonrecurring  costs  (NRC  Hi),  are  the  nonre- 
curring costs  associated  with  buying  more  of  a weapons  system  than  is 
currently  planned.  The  methodology  for  detenmining  these  costs  for  sys- 
tem slices  and  cost  related  constraints  is  beyond  the  scope  of  this 
paper,  but  it  is  discussed  in  detail  in  the  TRANSFORM  report.  Costs  used 
in  the  slice  methodology  are  not  true  budget  costs  but  are  related  to 
them;  tests  have  shown  that  no  significant  distortions  are  introduced  by 
their  use. 

b.  The  costing  of  individual  weapon  slices  uses  much  the  same  metho- 
dology as  used  in  calculating  the  individual  weapon  personnel  slices. 

The  system  slice  costs  are  calculated  directly  as  the  difference  in  the 
costs  of  FASTALS  troop  lists.  System  slice,  weapon  slice  and  individual 
weapon  costs  used  in  TRANSFORM  are  shown  in  Table  3. 

(1)  The  slice  modernization  or  base  level  nonrecurring  costs  are 
approximately  equal  to  the  procurement  costs  of  the  new  weapons  multi- 
plied by  the  numbers  of  new  weapons.  This  is  reflected  in  the  NRC-Lo 
columns  in  Table  3 for  the  TRANSFORM  forces. 

(iJ)  The  Active  NRC-Hi  or  activation  costs  are  equal  to  the  direct 
procurement  costs  of  the  total  number  of  each  type  of  weapon  plus  an  in- 
direct cost  which  covers  activation  and  training  costs.  The  indirect 
cost  is  the  difference  between  the  procurement  costs  of  all  weapons  in 
the  systems  slice  and  the  activation  costs  for  the  systems  slices.  It  is 
prorated  to  the  individual  weapon  types  based  on  the  number  of  weapons 
or,  if  there  are  differences  in  weapon  crew  sizes,  based  on  the  number  of 
crew  members.  It  is  to  be  noted  that  the  NRC-Hi  costs  for  the  Reserves 
reflect  only  the  procurement  of  additional  equipment  since  it  is  con- 
sidered unlikely  that  new  Reserve  units  are  needed  to  satisfy  force  de- 
sign requirements. 
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Table  3.  1RANSF0RM  Individual  Weapon  Cost  Data 
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(i)  The  recurring  costs  (RC)  are  calculated  by  allocating  the  re- 
curring costs  for  the  system  slice  among  the  weapon  types  in  the  slice 
based  on  the  personnel  per  weapon  slice.  It  is  realized  there  is  some 
difference  in  the  recurring  Operations  and  Maintenance,  Army  (UMA)  ac- 
count among  weapon  types,  but  this  is  not  deemed  to  be  significant  for 
weapon  types  in  the  same  slice. 


While  intertheater  lift  was  not  used  as  a constraint  in  TRANSFORM, 
minimization  of  shipping  weight  requirements  was  a goal  in  the  force  de- 
sign process.  System  slice  shipping  weights  for  unit  equipment  deployed 
after  O-day  as  calculated  in  FASTALS  are  listed  in  Table  4.  The  shipping 
weight  requirements  (weight  slices)  for  unit  equipment  associated  with 
each  type  of  individual  weapon  were  calculated  and  are  listed  in  Table  5. 
The  methodology  is  similar  to  that  for  personnel  slices.  In  this  case 
the  direct  weight  is  the  weight  of  the  weapon  and  identifiable  support 
such  as  the  prime  mover  or  a dedicated  ammunition  truck.  The  remainder 
of  the  slice  weight  is  then  prorated  to  the  weapon  types  in  the  slice 
based  on  the  numoer  of  each  type.  For  weapons  in  units  with  only  one 
weapon  type,  the  weight  of  the  unit  divided  by  the  weapons  per  unit  is 
considered  to  be  the  direct  weight. 
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Table  4.  Slice  Unit  tquipment  Shipping  Weight  Requirements  » 
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ADDITIONAL  WLAPON  SLICE  DATA 

Personnel,  equipment  and  cost  describe,  by  definition,  the  essential 
characteristics  of  a weapon  slice.  Weight  was  also  added  as  a descriptor 
in  the  previous  section.  In  developing  the  slices  and  quantitatively 
describing  them,  much  additional  data  becaiies  readily  av'ailable  with 
relatively  little  expenditure  of  effort.  To  illustrate,  the  following 
paragraphs  describe  some  types  of  slice-related  data  developed  for  design 
or  analytical  purposes  during  TKANbFORi-l;  the  tables  contain  the  TRANSFORM 
values,  mostly  at  the  system  slice  level. 
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Table  b. 


Weight  Slices 
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2.6C 

107  Grd 

22.0 

6.7 

107  SP 

29.0 

13.7 
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•Artillery  weights  include  prime  mover  and  battery  ammo  vehicles. 

^OW  weight  Includes  two  1/4  ton  trucks  and  1/4  ton  trailers. 

^Mortar  weights  include  weapon  transportation  and  platoon  amnunition 
vehicles. 

An  important  design  variable  and/or  constraint  in  many  force  design 
applications  concerns  the  overseas  stationing  of  troops  and  equipment. 
One  of  the  major  constraints  in  TRANSFORM  was  the  Lurope  manpower  ceil- 
’ng.  To  be  in  consonance  with  the  rest  of  the  program,  the  M-day  slice 
strengths  were  required.  These  were  calculated  for  individual  weapon 
types  in  the  same  manner  as  for  the  personnel  slices  described  earlier. 
To  reflect  the  effects  of  Prepositioned  Materiel  Configured  to  Unit  Sets 
(POMCUS),  D-day  slice  personnel  strengths  were  also  needed.  The  numbers 
of  each  type  of  weapon  and  the  personnel  slices  for  M-day  and  U-day  are 
1 i sted  in  Table  b. 


108  n 


Table  6. 


TRANShOHM  Weapon  and  Personnel  Slice  Data,  M-day  and  D-day 
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The  balanced  troop  list  produced  using  FASTALS  includes  all  units  in 
the  theater.  It  reflects  many  workloads  calculated  within  the  model  which 
are  printed  out  in  the  computer  report.  As  previously  described,  the  dif- 
ferences between  the  base  case  and  the  reduced  force  roundouts  are  the 
values  attributed  to  the  system  slices. 

a.  FASTALS  develops  the  total  theater  and  nondivi sional  populations 
and  presents  them  as  population  workloads,  time-phased  and  geographically 
located  in  the  division,  corps,  and  CUMMZ  areas.  Other  FASTALS  personnel 
workloads  which  can  be  related  to  weapon  slices  include  casualties,  hos- 
pital patients  by  location,  hospital  patient  returns-to-outy , replace- 
ments, and  personnel  by  branch.  It  would  even  be  possible  to  obtain  per- 
sonnel by  MJS,  if  someone  required  it,  through  use  of  the  Force  Stratifi- 
cation Program  at  the  TRADOC  System  Analysis  Activity  (TRASANA).  Table  7 
presents  the  TRANSFORM  total  theater.  Active  Army  and  Reserve  Component 
strengths  for  the  base  case  and  each  slice,  and  the  end-of-simulation 
divisional  population  and  theater  casualties. 

b.  FASfALS-developed  workloads  include  many  in  the  logistic  support 
area.  Port  and  airfield  operations,  intratheater  transportation,  direct 
support  and  general  support  automotive  and  aircraft  maintenance,  and  en- 
gineer construction  requirements  workloads  are  all  available.  These 
workloads  can  be  divided  into  system  slice  or  weapon  slice  workloads  us- 
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ing  the  techniques  already  described.  It  is  thus  possible 
tor  example,  the  impact  on  port  operations  ot  substituting 
helicopter  company  for  a tank  battalion.  For  illustrative 
d includes  W-Mghts  of  unit  equipment  and  dry  cargo  ship^H?a 


to  predict, 
an  attack 
purposes  Table 
into  the 


theater, 
ments. 


and  general  support  automotive  and  aircraft  maintenance  require- 


Table  7.  System  Slice  Personnel  Data 
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c.  The  effects  of  force  structure  changes  on  the  consumption  of  sup- 
plies are  also  predictable  using  the  slice  niethoool ogv . ^AST^LS  supplies 
are  divided  into  six  general  categories:  (1)  refrigerated  cargo,  (^) 
light  supplies  (rations,  clothing,  packaged  POL,  and  otner  minor  equip- 
ment), (J)  bulk  POL,  (4)  construction  material,  (b)  ammunition  of  all 
types,  and  (b)  major  items  and  repair  parts.  Ihese  supplies  are  allo- 
cated on  the  basis  of  pounds  per  nan  per  day  based  on  the  activity  of  a 
unit  in  a general  area  of  the  theater,  or,  in  the  case  ot  combat  units, 
on  their  coiabat  posture,  bupplies,  depending  on  tvpo  and  physical 
characteristics,  are  prestockod  to  reduce  transportat  ion  requi ri'ments 
after  initiation  of  hostilities.  Force  structure  changes  may  modify  pre- 
stock requirements  and  the  approximate  amount  can  also  be  predicted, 
bystem  slue  ammunition  consumption  has  been  included  in  lable  h to  show 
the  type  of  consumption  information  that  was  available  in  llvANSF Oi\M. 
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The  slice  netnodoloijy  has  introduced  a new  dimension  to  tne  force 
structuring  process.  Tne  wide  range  ot  information  that  can  oe  developed 
using  the  methodology  and  its  potential  application  to  proolems,  many  not 
even  considered ‘at  this  time,  would  seem  to  portend  continuing  growth  in 
its  capabilities  and  broadening  of  its  appl ications.  In  the  near  tern, 
it  will  be  used  by  CAA  in  a study  called  Conceptual  AFCLNT  Force  Design- 
1990  (CONAFOR-90)  for  which  the  tasking  directive  is  now  being  coordi- 
nated. This  study  will  require  extension  of  the  methodology  to  (UTO 
forces,  but  probably  not  in  the  detail  possible  with  US  forces.  For  US 
forces  a new  base  case  will  be  developed--a  not  inconsiderable  effort 
requiring  use  of  at  least  the  CtM,  FASTALS  and  iRANSMO  Models.  Mew  val- 
ues for  the  present  weapon  slices  will  be  calculated  and  weapon  slices 
will  be  developed  for  a modernized  Air  Defense  force.  In  addition  it  is 
expected  that  three  helicopter  system  slices  will  be  developed.  These 
slices  will  better  define  the  exact  size  of  the  attack  helicopter  slice 
and  will  focus  attention  on  the  function  of  utility  helicopters  and  the 
number  and  cost  of  command  and  control  aircraft.  (Major  parts  of  the 
latter  two  slices  are  how  in  tht  residual  slice.)  In  the  more  distant 
future,  increased  automation  of  the  slicing  process  can  be  expected,  con- 
currently with  the  application  of  the  methodology  to  widening  groups  of 
problems. 


Table  8.  System  Slice  Logistic  Support 


fortt/tl  iCf 

Qr| 

• ihfppaj 

. ST.'ii 

tft'ppea 

Slwil 

vS  4.ta 

u.o 

1 JOVI 

*«A.Aowr% 

Ik-W  ..c*' 

tw-Pl'C** 

lata  Cata  M 

).4«).oa 

1.374.44 

74 

l.<40.34 

444.33 

tana 

Seg.M 

3MI.1S 

S7).44 

M.4< 

00.49 

farca^l* 

ia.7 

^,l.4 

19-4 

<.l 

4.1 

lilTa 

in.ar 

<43. 07 

Sal.sa 

V.IS 

101.14 

Partant 

11.4 

17. a 

<u<o 

<.4 

lo.< 

ATvac 

11.14 

II.  7u 

14.74 

1.14 

14. S4 

1.1 

1.4 

0.1 

O.l 

l.S 

ArUllfrj 

1.0^a.t4 

<7S.4l 

S7r.44 

<4.74 

4>4  at 

ItfCanl 

}«.4 

<0.0 

14.4 

<.o 

43.7 

MrlUaptar 

141. lU 

4a. <4 

404.41 

14.4; 

4.1 

l.S 

<.l 

41.1 

<.o 

Apr  tar 

IH.M 

SS.<S 

110.41 

4.44 

34.47 

Atfca-^l 

S.l 

4.0 

3.1 

0.4 

3.7 

UfanCry 

JJO.Ol 

144.10 

103. «4 

M.41 

<S.4S 

Nrcant 

9.S 

10.4 

J.l 

<.3 

<.| 

Atf  OaftMt 

C 

Ul.f’ 

4.« 

134.34 

I.I 

0.4 

13.7 

fitaatar  latti 
Wpport 

44S.ll 

c 

<43.4* 

fl.44 

70.01 

parcant 

11. 1 

0.1 

7.0 

fatal  tlua 

1.07S.41 

<.34S.4) 

YM.M 

4<0.7^ 

Nrta«t 

lOr.4 

71.0 

K.l 

%4.< 

4<.4 

I««<*ial 

»<.|7 

S1I.3S 

40^.04 

73.41 

Aarcan 

«.o 

i;.* 

40.0 

7.4 

•#  cat*. 


HactHt  100  btcawt*  •f  cownCIni  ft  iu<*af«. 


SU.’..V-\r<Y 


Iho  slice  niet'ioitoloiiy , despite  its  intancy.  Mas  Meeii  sfiow'i  to  Mave 
great  tloxiDility  in  its  application  to  current  force  structuring  prob- 
lems. weapon  slices  do  provide  a new  ano  increinentdl  approach  to  force 
design.  Use  of 'this  methodology  should  De  considered  where  detailed 
knowledge  of  force  makeup  is  required. 
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ABSTRACT:  During  the  conduct  of  the  Conceptual  Design  of  the  Army  in  the 
Field  (CONAF)  IV  and  V Studies,  linear  programing  was  utilized  to  opti- 
mize the  design  of  the  US  force  structure  required  in  a European  scenario 
circa  1987  and  1988.  The  linear  programs  for  CONAF  IV  and  V were  con- 
structed utilizing  coefficients  derived  using  an  incremental  slice  meth- 
odology that  measures  support  in  terms  of  people  and  dollars  required  to 
place  an  individual  weapons  system  on  the  battlefield  in  1987/1988.  The 
derivation  of  these  coefficients  is  a subject  of  another  paper  entitled: 
"Weapons  Slices — An  Incremental  Approach  to  Force  Design":  to  be  presented 
by  Mr.  Robert  C.  Spiker.  The  linear  program  utilized  these  slice  coeffi- 
cients as  well  as  firepower  potential  and  a measure  of  reaction  power  to 
an  enemy  breakthrough  in  the  force  design.  Appropriate  manpower  and  dol- 
lar constraints  were  utilized  to  constrain  the  mathematical  model.  This 
force  design  methodology  was  expanded  for  the  Trade-Off  Analysis  Systems/ 
Force  Mix  (TRANSFORM)  Study,  from  the  CONAF  V model  that  optimized  only 
one  objective  function,  to  a multiple  objective  optimization  process 
(goal  programing).  This  latter  methodology  will  be  expanded  and  improved 
for  the  projected  study  now  envisioned  to  study  force  design  for  the  Allied 
Forces,  Central  Europe  in  1990. 
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SUBJECT : The  Use  of  Coal  Hrogramniing  in  the  Theater  Level  Design  of 
Forces 

AUTHORS:  COL  Rooert  E.  RoOinson 

LTC  Edward  E.  Hildreth,  Jr, 

AGENCY;  USA  Concepts  Analysis  Agency 

I . Background 

A.  In  the  early  197U's  a series  of  studies  were  initiated  by  the 
Army,  in  an  attempt  to  identify  viable  alternatives  in  force  design  in 
the  midrange  period  (10-12  years)  that  would  optimize  the  use  of  avail- 
able resources.  These  studies  recognized  that  highly  modernized,  low- 
risk  forces  would  not  be  affordable  in  the  austere  atmosphere  of  post 
Vietnam.  The  studies  were  entitled:  Conceptual  Design  of  the  Army  in 
the  Field,  or  CONAF.  CONAF  force  design  methodology  has  evolved  through 
the  various  editions  of  the  CONAF  study.  The  most  recent  edition.  Phase 
V,  was  published  in  October  197b.  A brief  review  of  the  CONAF  methodol- 
ogy is  included  as  an  introduction  to  the  techniques  used  and  to  identify 
improvements  in  the  methodology  that  occurred  in  its  most  recent  applica- 
tion: Trade-Off  Analysis-Systems/Force  "ix  (TRANSFORM). 

B.  Outline  of  CONAF  Methodology.  The  major  facets  of  this  force  de- 
sign process  are  as  follows: 

Partition  Base  Case  into  System  Slices 

Design  forces  at: 

Weapons  System  Level 
Battalion  Level 
Division  Level 
Using  linear  programing 

Verify  design  using  Theater  Simulation 

C.  Selection  of  System  Slice  Variables.  Starting  in  the  CONAF  IV 
Study,  it  was  determined  that  the  most  descriptive  level  for  investiga- 
tion of  a force  was  at  the  weapon  system  or  family  of  weapons  level.  For 
CONAFV,eight  weapons  systems  were  used  as  design  variables.  They  were: 
tanks,  armored  personnel  carriers  w/TOW,  armored  personnel  carriers,  an- 
titank guided  missiles,  mortars,  helicopters,  artillery  and  infantry. 

0.  Partition  of  Base  Case  into  System  Slices.  This  phase  of  the  de- 
sign process  required  that  the  FY  77  force  be  modernized  in  accordance 
with  DA  plans  and  a modernized  force,  circa  19bB,  be  defined.  This  force 
was  designated  as  the  Base  Case  BB  force.  Witn  the  definition  of  the 
force,  certain  characteristics  were  descrioed  relative  to  the  design 
variables.  This  description  of  the  force  became  known  as  the  system 
slices. 
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t.  Use  ot  a Matncmaticdl  Model  toDesign  horces. 

(1)  Resources  Required.  System  slice  coetticients  generated  tor 
the  Base  case  BS  force  were  used  to  tonnulate  linear  relationships  be- 
tween the  design  variables  and  were  used  to  estaulish  constraints  on  man- 
power, dollars,  materiel,  strategic  lift  or  other  resources  of  interest. 
Ror  CONAR  V,  resource  constraints  using  system  slice  variables  were  tormu- 
lated  to  recognize  the  limits  on; 

(a)  Cash  flow  availaole  to  finance  Base  Case  BH. 

(o)  Peacetime  US  troop  population  in  turope. 

(c'  The  total  slice  related  personnel  of  a fully  supported  force. 

'his  method  was  also  used  to  descrihe  the  requirements  for  the  Active  ahd 
Reserve  components  of  the  total  force. 

Design  Criteria.  The  CONAK  methodology  postulated  that  a force 
designed  to  match  the  various  types  of  Pact  firepower  potential  (FPP)  at 
critical  points  in  the  scenario  would  be  able  to  execute  a forward  de- 
fense and  limit  the  Pact  advance.  Four  types  of  firepower  potentials 
were  considered.  Each  described  a weapons  system  potential  against  the 
appropriate  type  target  in  a particular  combat  posture.  The  four  types 
of  firepower  considered  are  shown  in  Table  1. 

Table  1.  (irepchor  Potential 
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The  FPP  scores  selected  were  tnose  attributed  to  FPP  for  a Pact  attack 
against  a US  prepared  defense  as  best  describing  the  majority  of  engage- 
ments that  could  occur  in  the  selected  scenario. 

(J)  Predator  versus  Prey.  The  US  was  viewed  as  a predator  who 
tried  to  match  the  Pact  FPP  on  the  battlefield  (the  prey).  Using  the 
Intelligence  Threat  Assessment  Detachment  (ITAD)  data,  the  time-phased 
arrival  of  trie  Pact  targets  on  the  battlefield  was  detetmiined.  It  then 
became  the  force  designer’s  problem  to  optimally  match  that  threat  given 
the  constraint  of  resources. 

(4)  Liti^eqr'  Programing.  The  mathematical  model  chosen  for  CONAF  V 
was  linear  programing.  Appropriate  objective  functions  were  derived  that 
quantified  the  force’^s  ability  to  react  to  Pact  breakthrough  tactics. 
These  various  objective  functions  were  used  separately  in  conjunction 
with  the  resource  constraints  and  design  criteria  to  optimally  design 
forces.  The  linear  program  generated  three  types  of  solutions.  The 
first  was  the  weapons  system  solution,  in  teniis  of  an  individual  weapon. 
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e.g.,  Xj  = J,y4i?  tanks.  Ihis  solution  provided  an  insight  into  the  opti- 
mum mix  ot  weapons  systems  that  the  resource  constraints  am.  design  cri- 
teria of  the  iiiathematical  model  generated.  The  next  step  was  to  trans- 
late system  slice  coefficients  from  the  weapons  system  model  to  battalion 
model.  This  translation  process  was  done  by  assuming  linear  relation- 
ships, that  is,  if  the  hard  firepower  potential  for  one  XMl  tank  is  .Ufa4U 
points,  then  b4  tanks  in  a tank  battalion  would  have  b4  x .0b4U  = 3.4bb 
points  and  similarly  the  3bU  tanks  in  an  armored  division  would  have  3bU 
X .Ub4U  = 23. U4  points.  Thus  the  problem  can  be  structured  at  three  lev- 
els: (1)  weapons  system,  (2)  battalion,  and  (3)  division.  Force  design 
solutions  were  obtained  for  CONAF  V at  all  three  levels.  Appropriate 
insights  obtained  at  the  weapons  system  and  battalion  module  level  were 
utilized  in  the  design  of  conceptual  divisions. 

F.  Indexing  Divisional  Candidates.  Since  linear  programing  could 
optimize  only  one  objective  function  at  a time,  considerable  sorting  of 
solutions  was  necessary  as  solutions  to  the  various  objective  functions 
were  obtained.  A technique  called  decision  making  under  uncertainty 
(UMUU)  was  used  to  narrow  candidate  divisions  to  a manageable  number  for 
the  final  step  in  the  CONAF  methodology. 

G.  Combat  Simulation.  The  final  step  consisted  of  performing  a com- 
bat simulation  in  the  theater  level  Concepts  Evaluation  Model  (CEM). 
Results  were  compared  with  Base  Case  BB  to  verify  force  design  efficien- 
cies. 

H.  Si^njmary.  The  figure  below  summarizes  the  CONAF  force  design 
methodol ogy . 


Figure  1.  CONAF  Force  Oesign  Methodology 
1 1 . Goal  Program  Design  Methodology . 

CONAF  V force  design  methodology  was  used  in  the  conduct  of  the  recent 
TRANSFORM  Study.  The  original  impetus  for  TRANSFORM  was  to  determine  the 
implied  trade-off  that  increased  attack  helicopter  assets  in  the  context 
of  the  new  Division  Restructuring  Study  (DRS)  heavy  division  would  cause. 
During  the  course  of  the  TRANSFORM  Study  however,  a decision  on  aviation 


structure  ended  the  need  tor  further  investigation  of  helicopter  struc- 
ture, and  attention  was  focused  on  usiny  the  CONAf  force  design  metho- 
dology to  evaluate  the  L)RS  organization.  TRANSfOKM  used  a more  powerful 
optimization  technique,  the  goal  program.  Ihe  goal  program  allows  the 
force  designer  to  perform  multiple  optimization  by  establishing  a series 
of  objectives  which  are  ordered  into  priorities.  This  technique  enlarges 
the  flexibility  of  the  CUNAf  mathematical  model  to  treat  several  objec- 
tives simultaneously  without  having  to  reformulate  the  problem  each  time 
the  model  is  used  or  when  no  solution  exists  (infeasible  solution). 

A.  Description  of  Goal  Prograiiii ng.  Uoal  programing  is  a mathematical 
technique  which  optimizes  several  objectives  at  a time,  in  a priority 
ordered  sequence.  Linear  programing  may  be  viewed  as  a special  case  of 
goal  programing  where  all  constraints  are  priority  one  and  the  single 
objective  is  priority  two.  As  an  example,  a force  design  problem  may 
begin  with  various  types  of  divisional  and  nondivisional  units  as  candi- 
date variables.  Ihe  problem  could  be  to  discover  that  combination  of 
variables  which  best  meets  turopean  manpower  limits  in  peace  time  and 
matches  hard,  medium,  soft  and  artillery  firepower  potential  to  opposing 
targets  at  events  in  the  scenario  buildup.  Ihe  objective  could  be  to 
minimize  the  costs  required  to  achieve  firepower  potential  matching  with- 
out exceeding  manpower  limits.  As  a linear  programing  problem,  there  are 
one  objective  and  five  types  of  constraints.  Ihe  program  may  not  be 
mathematical ly  solvable  by  linear  programing.  In  such  cases,  the  stated 
problem  is  said  to  be  infeasible.  Ihe  military  analyst  must  then  devise 
some  method  to  decide  new  values  for  the  constraints  which  will  both 
yield  a feasible  solution  and  "best"  meet  the  requirements  of  the  prob- 
lem. (ioal  Programing  will  always  provide  a solution.  Such  solutions  may 
underachieve  some  objectives.  Ihe  problem  stated  above  could  be  solved 
by  using  goal  peograming.  The  "constraints"  could  be  treated  as  priority 
one  objectives  and  minimizing  the  costs  could  be  priority  two.  but  goal 
programing  could  also  reverse  the  priorities,  weight  objectives  differen- 
tially within  a priority  level  or  spread  out  less  important  objectives  to 
lower  priority  levels,  boal  programing  seeks  to  satisfy  priority  one 
level  goals  first,  then  adjusts  the  solution  to  best  achieve  priority  two 
Objectives  without  preempting  the  achievement  of  priority  one  goals. 

This  process  continues  through  all  priority  levels  stated  by  the  problem; 
seeking  the  best  fit  without  violating  higher  priority  achievement. 

II.  Kequimiients  for  Ooal  Programing.  Ihe  following  summarizes 
conditions  needed  to  state  a problem  in  goal  program  form; 

(1)  A series  of  objectives  must  be  stated  in  mathematical  terms. 

The  mathematical  model  of  TKAhSTUKM  met  this  requirement. 

(i)  A numerical  value  must  be  established  for  each  objective  as  a 
goal.  In  TRANSfORM  firepower  potential  objective  values  were  sot  by  ana- 
lyzing the  threat  and,  in  particular,  selected  events  in  the  scenario 
buildup  of  the  threat  force.  Cost  constraints  were  set  by  using, sepa- 
rately, annual  recurring  and  nonrecurring  dollar  cash  flows  which  would 
be  available  to  purchase  and  sustain  the  base  case  through  end  of  LY  dd. 

(3)  The  objectives  must  be  ranked  in  order  of  importance.  Lor 
TRANSFORM,  this  ranking  was  inferred  from  guidelines  established  by  the 
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tar.lnn9  directive  and  the  SAii.  If  the  military  analyst  is  indifferent  to 
such  a ranking,  all  objectives  could  be  made  priority  one.  In  general 
the  following  ranking  was  followed: 

(a)  Stay  within  cost  constraints  limits  (for  both  nonrecurring 
and  annual  recurring  cash  flows). 

(b)  Stay  within  European  manpower  stationing  limits. 

(c)  Do  not  exceed  current  active  and  reserve  manpower  spaces. 


(d)  Meet  force  design  criteria  in  tenns  of  firepower  potential  as 
modified  by  suppression  or  requirements  to  concentrate  firepower. 

(e)  Do  not  exceed  materiel  prestock  limits. 

(f)  Minimize  strategic  lift  tonnages. 

(4)  Objectives  must  be  grouped  into  priority  levels.  In  TKANSFORM 
all  firepower  matching  objectives  after  D-day  were  grouped  into  a single 
priority  level.  Nonrecurring  and  annual  recurring  costs  were  grouped 
into  a single  priority  level. 

(b)  Weights  must  be  assigned  to  objectives  grouped  within  the  same 
priority  level.  Where  it  is  not  clear  how  to  weight  equally  preferred 
objectives  differentially  (grouped  within  the  same  priority)  they  may  be 
initially  weighted  equally  and  the  results  analyzed  to  discover  where  a 
difference  in  weights  would  change  the  solution.  Several  cucf.  solutions 
may  be  displayed  for  the  military  planner.  If  a given  priority  level  set 
of  Objectives  are  all  achieved,  differential  weighting  will  have  no  im- 
pact on  the  solution.  In  TRANSFORM  differential  weighting  was  not  re- 
quired. 


(6)  Finally,  it  must  be  decided  whether  an  attempt  will  be  nvide  to 
minimize  the  negative  deviation,  minimize  the  positive  deviation  or  equal 
the  goal.  In  TRANSFORM,  firepower  potential  was  to  be  met  or  exceeded, 
within  given  resource  goals  or  less,  if  possible.  Stating  a goal  as  an 
equality  is  inherently  a severe  requirement  and  can  unnecessari ly  limit 
useful  solutions. 


C.  TRANSFORM  Mathematical  Models. 

(1)  Two  separate  goal  programs  were  utilized  in  the  force  design 
process.  These  two  sets  consisted  of: 

(a)  A systems  level  model  which  yielded  the  weapons  systems  solu- 
tion. 

(b)  A division  level  model  which  selected  divisional  level  vari- 
ables as  solutions  to  the  program  and  yielded  the  conventional  force  de- 
sign and  the  DRS  force  design. 

doth  models  contained  the  same  achievement  objectives.  Ihe  initial  sys- 
tems level  model  yielded  a solution  that  caused  the  priorities  of  the 
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mathenidticdl  model  to  be  altered.  The  revised  priorities  tor  achieving 
objective  levels  were  then  utilized  in  the  division  level  model  tor  the 
conventional  and  ORS  design  forces. 

(<?)  Composite  System  Used.  The  following  composite  systems  were 
used  as  variables  in  weapons  systems  solutions:  Note:  a composite  sys- 
tem is  a weighted  average  of  the  mix  of  actual  systems  in  the  slice. 
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(J)  establishing  Priorities.  Goal  programing  permits  a solution 
optimizing  to  multiple  objectives  within  an  ordered  set  of  priorities. 

The  degree  that  the  solution  achieves  a given  priority  level  will  not  be 
preempted  by  any  lower  priority  level  objectives.  This  requires  that  the 
highest  priority  levels  be  the  most  important;  priority  level  1 must  con- 
tain any  requirements  which  are  needed  to  implement  the  solution.  In  the 
mathematical  model,  this  requires  two  variables  for  each  system  tor  each 
event:  one  incorporating  the  appropriate  low  nonrecurring  cost  coeffi- 
cient and  the  second  incorporating  the  high  nonrecurring  cost  coeffi- 
cient.* The  high  cost  coefficient  must  be  used  when  the  number  of  sys- 
tems selected  exceeds  currently  programed  levels.  Ihis  fact  must  be 
clearly  imbedded  in  the  mathematical  problem  statement.  This  is  achieved 
by  setting  as  a priority  one  objective,  a limit  on  the  number  of  each 
system  type  that  can  oe  selected  with  the  base  level  cost  coefficient. 
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(4)  Achievement  Function.  In  addition  to  an  optimal  choice  of  num- 
ber of  weapons  systems  or  types  of  units  available  to  be  chosen,  the  main 
output  of  the  goal  program  is  an  achievement  tunction  which  measures  the 
i nabi 1 i ty  of  the  solution  to  achieve  its  priorities,  in  comparing  two 
achievement  functions  having  the  same  objectives,  the  smaller  number  sig- 
nifies the  better  achievement  function.  The  relative  measure  of  the  op- 
timality of  a goal  program  is  how  well  it  minimizes  the  achievement  func- 
tion. Table  4 illustrates  the  composition  of  the  achievement  function 
for  the  transform  goal  program. 
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(5)  Structure  of  the  Goal  Program.  The  solution  to  the  goal  pro- 
gram considered  as  variables:  (l)  Type  of  weapons  system  or  module  (di- 
vision level);  (2)  location  of  the  weapons  system  or  module  selected  and 
(3)  the  time  at  which  the  weapons  system  or  division  level  unit  could  be 
counted  as  contributing  to  the  battle.  Table  5 represents  the  unit,  lo- 
cation and  firepower  contribution  scheme  of  the  goal  program. 
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(a)  Weapons  System  Model . Stating  the  problem  mathematically: 

1^.  Variables  1-8 

= Number  of  European  based  tanks  (tk) 

Xo  = Number  of  European  based  light  antitank  tracked 
vehicles  (LATTV) 

%2  = Number  of  European  based  armored  personnel 
carriers  (APC) 

X4  = Number  of  European  based  antitank  guided 
missiles  (ATGM) 

Xij  = Number  of  European  based  mortars  (mort) 
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Number  of  Luropean  based  helicopters  (hel) 

X,  = Number  of  turopean  based  artillery  pieces 
(arty) 

Xy  = Number  of  turopean  based  infantrymen  (inf) 

tquations  for  the  goal  program  were  written  in  teniis  of  ttie  individual 
weapons  systems.  For  example  the  mathe  latical  statement  tor  Objective  U, 
the  peacetime  manfiower  restriction  in  turope,  would  be  the  linear  equa- 
tion; 

g.jjbooxj  t o.ogbic’x^  *■  j.oyuuuxj  ♦ i.r/buux^  + ii.jw^uux,j 

+ i?J.0/40UX^  f 40,l3bb4Xy  f l.JJdUUXy  < 61UUU 

Ihe  number  81,000  represents  the  base  case,  slice-associated  population 
in  turope  in  Active  units  and  each  coefficient  represents  the  slice  popu- 
lation. IRANSFORM  equations,  such  as  the  above,  were  assumed  to  remain 
linear  over  a range  of  change,  tquations  representing  each  of  the  J1 
objective  functions  were  formulated  to  describe  the  respective  objectives 
and  their  desired  achievement  levels. 

Variables  g-lb.  The  next  8 variaoles  represented  the  same 
ordering  of  weapons  systems  but  placed  them  in  Europe  prestock  (POMCUS): 

Xi^  = number  of  POMCUS  tk 

Xjj  = number  of  POMCUS  LATTV 

Xjj  = number  of  POMCUS  APC 

X^^  = number  of  POMCUS  ATOM 

Xj^j  = number  of  POMCUS  mort 

Xj^  = number  of  POMCUS  hel 

XiL  = number  of  POMCUS  arty 

X,.  = number  of  POMCUS  inf 
lb 

Selection  of  a weapons  system  from  POMCUS  stocks  contributed  firepower 
potential  (FPP)  to  the  force  on  D-day  and  required  no  strategic  lift  of 
unit  equipment  from  CONUS. 

3.  Variables  17-^4.  The  next  eight  variables  represented  the 
choice  of  a stateside  weapons  system  and  again  were  arrayed  in  the  same 
cyclical  order.  Selection  of  a stateside  weapons  system  required  stra- 
tegic lift  of  the  equipment  and  did  not  contribute  FPP  until  D+14. 

4.  Variables  ^b-48.  An  identical  set  of  equations  were  formu- 
lated with  the  exception  that  the  coefficient  representing  the  nonrecur- 
ring cost  of  the  weapons  system  (Objective  2?.)  represented  the  activation 
or  higher  cost.  Once  the  base  case  level  of  a particular  weapons  system 
was  exceeded,  e.g.,  3b44  tanks.  Priority  1 required  that  that  particular 
weapons  system  be  selected  from  variables  X^t,  through  X^y  and  that  the 
higher  nonrecurring  cost  be  assessed  for  that  system. 

(b)  Division  Level  Model.  For  the  formulation  of  tne  division 
level  model  it  was  only  necessary  to  know  the  density  of  weapons  systems 
in  a division. 


Yj  - number  of  European  based 
Y^  = number  of  European  based 
Yj  = number  of  European  based 
Y^  = number  of  European  based 
Yg  = number  of  European  oased 
Y(j  = number  of  European  based 
Y7  = number  of  European  based 
(DRS)  heavy  divisions 
Yy  = number  of  European  based 
companies 

labie  6.  Density  of  k’p.if’Oii 
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Then  t)ie  formulation  of  Objective  13  for  the  division  level  model  would 

10272. 9Y^  + 13242. 4Y^  + 12918. UY3  + 3933. 4Y4  + 3115. UYj,  + 2889. 8Y,j 
+ 14873. 4Yy  + 167Ul./Yy  < 81UUU 

Variables  Y^  through  Y^^^  and  Y17  through  Ypj  represented  the  same  order- 
ing  of  divisions  but  located  them  in  POMCUS  and  CONUS  respectively.  The 
identical  method  for  assessing  tiie  higher  nonrecurring  cost  associated 
with  the  activation  of  new  units  was  used  at  the  division  level,  through 
the  use  of  a separate  set  of  variables  (Y^,  through  Y.,.)  which  contained 
the  higher  NRC  coefficients. 

(t>)  Combat  Effectiveness  Objectives.  Imbedded  in  the  goal  program 
in  the  mathematical  model  are  the  design  objectives  which  quantified  the 
desired  combat  effectiveness  of  the  force.  These  oojectives  were:  Ob- 
jectives 1-12  (hard,  medium,  soft,  and  artillery  firepower  on  M,  D and 
D+19)  and  Objectives  16  through  19  (reaction  power  on  M-day). 

(a)  Firepower  Potential  Application.*  This  firepower  potential 
methodology  recognizes  three  types  of  targets:  (1)  soft,  (2)  medium,  and 
(3)  hard.  A tank  is  an  example  of  a hard  target,  an  ARC  is  an  example  of 
a medium  target,  and  a ground-mounted  antitank  guided  missile  is  an  ex- 
ample of  a soft  target.  The  value  of  this  methodology  becomes  apparent 


*More  explicit  details  of  the  firepower  potential  inetnodology  are  pub- 
lished in  CAA  Technical  Papers  TP-73-7  and  TP-74-8. 


when  looking  jt  j system  such  as  the  9rouncl-mounted  antitank  weapon.  Its 
firepower  is  best  employed  against  hard  targets,  yet  it  is  most  vulnera- 
ble to  area  (soft)  firepower  such  as  that  of  mortars  and  artillery.  The 
f h’t'  value  changes  differentially  by  type  of  engagement. 

(b)  Influence  of  Tactical  Posture.  Since  this  study  was  designed 
for  forward  defense,  the  posture  chosen  was  a Warsaw  Pact  attack  against 
a US  prepared  defense.  A US  force  optimized  to  perform  well  in  this  mode 
will  have  a defensive  character. 

(c)  L)S  as  a Predator.  US  weapons  systtmis  were  considered  as  the 
predator  trying  to  match  their  hard,  medium  and  soft  firepower  to  the 
Pact  hard,  medium  and  soft  targets  (the  prey).  Ihis  was  the  first  prin- 
ciple of  design.  Its  goal  was  to  match  or  exceed  each  type  of  Pact  un- 
suppressed firepower  potential  with  the  suppressed  firepower  potential  of 
the  US  weapons  systems.*  An  example  of  such  an  objective  is  Objective  1 
(match  or  exceed  Pact  hard  FPP  M-day)  in  the  weapons  system  model. 

.ObOA’Xj  f .0^01 1\^  t OXj  + .00^b^X4  ♦ OX^  ♦ .03d2UXjj  ♦ .OOAHX^  + 

.0U0U')X,i  ' lb4.S 

c'  — 

whore  X^  through  are  turopean  based  weapons  system  level  variables  as 
above.  Again  by  knowing  the  density  of  weapons  systems  in  a division. 
Objective  1 could  be  fonnulated  in  teniis  of  division  level  units  or; 

/.HlbHSY^  + ^!g,Jb441Y^  ♦ + 7.bb09bY4  + b.^91/4Y^  + 

♦ JJ,4P%UY;  + J4.8Jb49Y„  ' lb4.b 

This  fomiula  represents  a D-day  hard  firepower  design  objectives  for  the 
weapons  system  model  and  the  division  level  model  respectively.  For  ex- 
ample. in  the  fourth  tenn  of  the  first  equation,  ,002b2X.,  the  .002b2  is 
the  fiard  firepower  potential  of  a suppressed  AlbM.  The  Ib4.b  is  the 
amount  of  Pact  firepower  potential  in  hard  targets.  The  principle  of 
matching  combat  power  in  this  fashion  cannot  be  proven,  but  it  was  postu- 
lated that  Pact  cannot  gain  ground  significantly  without  in  turn  exceed- 
ing significantly  each  type  of  US  firepower  potential. 

(d)  Counter  Artillery  with  Artillery.  Tnis  study  exploited  two 
characteristics  o7  artillery.  FTrst,  o7  the  eight  systems  considered.  US 
artillery  is  the  only  weapon  that  can  hit  Pact  artillery.  Second,  ar- 
tillery is  often  the  first  firepower  which  is  available,  because  of  the 
range  artillery  has,  it  can  change  targets,  in  many  cases,  without  the 
delay  required  in  altering  its  position.  This  characteristic  is  an  ad- 
vantage during  Pact  penetrations.  For  these  reasons,  a further  design 
postulate  was  tnat  artillery  firepower  potential  must  equal  or  exceed 
Pact  artillery  firepower. 
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*Suppression  of  US  weapons  systems  was  considered  as  limiting  the  full 
t-Pi’  available  and  were  selected  ji*.i()mehf.a  1 1y,  e.g.,  the  ground  mounted  TOW 
was  suppressed  85'' . 
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(/)  Kej^ationship  ot  Ulijectives  and  Priori_ties.  ladlo  / reflects 
the  31  objectives  of  the  goal  program  and  their  grouping  into  priorities. 
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n.  Summary  of  cloal  Programing  for  IRAN^HiRM.  Ihis  study  used  goal 
programing  as  a system  mix/force  mix  tool  of  discovery.  It  used  goal 
programing  to  design  mixes  within  a set  of  reguiremonts  which  ranged  from 
absolute  (stay  within  cost  constraints)  to  desiraole  iminimize  strategic 
lift  regui r»'ments) . By  investigating  the  impact  ot  reordering  priori- 
ties, useful  insights  were  gained  on  potential  force  structure  tradeoffs. 
By  using  goal  programing  with  conventioiial  units  and  restructured  units 
as  candidate  variables,  new  perceptions  ot  repackaging  of  divisional 
forces  were  gained,  tloal  programing  could  also  have  been  used  to  design 
conceptual  divisions. 
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III.  Methodology  Summary. 

The  TRANSFORM  study  adopted  and  extended  the  CONAF  mathematical  model  and 
methodology.  It  used  a systems  approach  to  force  design  which  accounts 
for  individual  weapon  system  potential  performance  and  support  and  man- 
power required.  A mathematical  model  which  states  desirable  force  objec- 
tives and  resource  constraints  is  translated  into  a problem  statement  in 
which  the  variables  represent  types  of  units  - conventional,  restructured 
or  conceptual.  Goal  programing  was  used  as  an  optimization  technique  to 
discover  force  and  systems  mixes  which  best  met  an  ordered  set  of  condi- 
tions. Designed  mixes  were  verified  by  static  analytical  comparisons 
with  the  base  case  and  by  dynamic  combat  simulation. 
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TlTl.K:  Altoriiat  lvt‘  Concepts  for  Kvalii.iC  lug  lUvislon 

Korct'  Structures 

AUTHORS : Or.  Vhlllp  H.  l.owrv  and  Henrv  .1.  Schroeder,  .Ir. 

Ceneral  Research  Corporation 

ABSTRACT:  As  a base  line  to  serious  thought  on  m»'thodology,  and  the 

■application  of  current  or  new  i^R/SA  tools  In  support  of  the  Armv  of  the 
19rt0’s,  offered  here  Is  an  overview  of  10  vears  of  associated  activity 
In  and  with  the  Armv. 

in  this  overview  .luthors  concentr.ite  I'n  selected  force 
structure  an.ilvses  .ind  the  concepts,  methodologies,  .ind  tools  used  In 
past  kev  decision  m.iklng  relating  to  dlvlslini  restructuring  since  World 
W.ir  11.  The  .uithors  then  .iss«'ss  the  s t .i  t e-i' t - 1 he-.ir  t .uiil  utility  of 
OK/SA  methods  for  ev.ilu.it  Ion  ol  doctrine  .ind  procedures,  for  the  .in.ilvsls 
and  assessment  ot  .Vrmv  I'peraf.ons  and  <'t  lorie  pi. inning  and  design. 

Hie  interact  iv'n  between  OR  SA  lechnlijues.  test  .ind  evaluation,  staff 
•inalvsis,  .ind  tlu'  decision  ntiking  pr.iiess  will  be  projected  and  related 
Issues  discussed. 

Authors  retiT  ti'  selected  specific  relevant  events  In  which 
they  participated  to  illustr.ite  the  Inter.ict  lini  between  methodology  .iiul 
division  restructuring  decisions. 


Alterant  ivt'  Coavepti:  for  Kv.ul  anti  a^.’  I'ivir.ioa  Koree  ;ttriK-ture;i 

Alfl'l'A 'Ki> : Mr.  Henry  .T . oohreedor 

Dr.  t'hilip  H.  Lowry 

OHDiAMI-l/VTlON;  ueaeral  HeAeJU'Oti  Lorpornt ion 

L'inoe  1^)  the  UD  Arny'  hnn  fveKleH  I'ive  new  Hivinion  r.trueturei-. , n;> 
s t'.v 'w a on  this  slide. 

■ NKw  UP  /VKMY  DlVIl^ON  DTRUD'ntRF.D^ 


1') 

THIANf.UlAK  DIVUhON 

^McNair  Heix'i't) 

lo;,  1 

AIHHOKNK  n IV  ID  ION 

lost' 

I'KiriX'MK'  in V ID  1 ON 

h’KNTANA  Dtinly') 

lOt'l 

KOAD  ri VI DION 

lOi'.. 

AlHMOHILK  DIVIDL'N 

v'.iow  .'.e  i'oar-i ) 
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hOKD  Dtudyi 

■.'.■o  of  these  divisions  were  spec  ini  i le.D-t  lie  nirhorne  and  airnioMle — 
the  renniader  nmoaated  to  n rin.L  r reotvnni  dnt  i ti  of  the  co;;;bnt  elements  .'f 
the  Ul'  Ariry . 

riiree  of  the  new  tivislons  were  extensively  studied  nisi  testcvi 
her’ore  beinc*  fielded,  ns  slnwa,  nn.i  two  wt're  not. 

'.lie  studies  nad  test  repoi'ts  have  many  elements  in  comiivn.  Nearly 
all  emphasized  tactical  effect! veru'ss  and  flexibility  in  combat. 

Our  emphasis  this  afternoon  will  not  be  on  i npt-overaents  in  evaluating 
tactical  effectiveness  atid  flexibility.  Kathei-,  wo  wilu  concentrate  on 
some  alternative  concepts  that  we  believe  have  been  neglected. 

nie  concepts  we  will  discuss  can  be  divided  into  three  categories. 


.tL IFllNATIVE  f ONf y.ri’-.t 

fl-KATKiUc 
TAD 'r  lOAli 
KiliVK  <UvKA 


Idle  reason  for  discussiiig  strategic  concepts  in  evaluatuig  divisional 
force  structures  is  th.at  the  lb-  is  hi  a I'undamental  ly  diffei'ent  pi'sition  from 
any  other  ma.lor  power.  Idieref'-'t’e  we  cannot  off-hand  adopt  the  st.ructui’es 
the  derman  Army,  the  I'oviet  Army,  or  the  [srnel  i Arry. 


1 1 Ob 


■er 


I'hf  U:'>  Ar:!!^'  is  not  struolured  to  I■i^’.ht  in  ttu“  AINU;'  or  in  udjaron’ 
Itind  art'tis . Canada  and  Mt'xioo  post*  tu'  tfiro.at  . -'.ir  has  t'oon 

struoturod  to  !■i^:^lt  tliousands  oi'  nii  U>s  aoross  oooans . iho  .’I'vii'ts  say 
no  nati>!i,  iu'wovor  {kwo  r :’uL , oan  suppoi't  in  poaoetino  tiu'  A!"r;y  i‘eq,ii.’'ei 
to  r'iftht  and  win  af.:ainst  a najor  advtn-sary.  Ci.'r.i  lai’iy , we  find  it  in- 
feasible to  ::mintain  in  Europe  ai  i tiie  Ain^v  f^  rees  i-equitani  to  iefeat 
a Warsaw  i'aot  attaok.  Instead,  we  plan  to  reinforce  the  t roops  in  Eur  pe 
in  an  OEerf-tenoy . We  have  uO  percent  of  our  active  conbat  battalions 
deployevi  in  Europe  and  alv'ut  ‘>0  percent  of  our  battalion  eip.ip:nent  tin-re. 

It  follv'ws  tliat  division  structu:'es  stiould  be  evaxuated  in  tei-ru; 
the  tir.e,  revpiired  effoi-t,  and  feasibility  of  Ev'vi!;p;  it  t'ror.  the  'v'NIlf. 
to  tf’.e  theate:-  and  to  siuitain  it  of.ce  it  p:ets  there.  'Idiii'  is  in  additii.'u 
to  its  evaluation  for  tactical  effectiveness  once  depl  'yt'd. 

In  other  words. 


AI/rEHlIATIVE  CC:;CEt"A~ 

C'TKA  i'l-XI  I C 

• BAlANCllId  CTKATiXIlC  Mv'BILlTY 
AMP  TACI’ICAh  EEFECriVENK;’;' 

TACTKhXl. 

ntlfXH  AHhlA 


It  is  'f  little  ViLlue  to  have  an  effective  force  tb.at  car.noi  be  deployed 
.iuick.ly  overseas-.  it  also  is  of  little  value  to  deploy  quickly  an  i;i- 
effective  force.  Titus,  a balance  is  needed  between  tactica-  effectiveness 
:ir.d  speed  of  deployment  . 

• • w « » 

l.ets  Look  at  history  from  tw.'  p.'ints  o:'  view;  our  response  ir.  the 
past  to  tlie  strategic  requirements,  ar.d  our  respor.se  to  tactical  req..i:a'- 
p.ents . 

First,  our  response  to  the  strategic  requirements. 
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This  chart  i.;  a plot  the  percent  of  ranpower  in  oor.bat  divisions 

an  i n in-livisional  conbat  anits,  shown  on  the  ordinate,  arainst  the  total 

3trer.i.:th  /f  the  US  Aa-ry  ver  the  Last  60  years. 

■ft'e  start  in  1916  at  near  70  perceiit  and  drop  duriiif;  World  War  I to 

a little  ov'er  lO  percent,  all  in  Europe.  Then  we  p-'adually  increase  back 

up  to  TO  percent  in  19l0.  World  War  II  f 'Hows  almost  the  same  slope  as 
World  War  I down  to  abijut  ^0  percent.  Tlien  it  starts  hack  up. 

Then  ca.me  the  Korean  Wa”. 

This  was  the  •"irst  war  in  the  history  the  US  when  we  were  in  a 
hurry;  when  we  .needed  fast  deployment  of  co.mbat  forces. 

The  slope,  shown  between  1950  and  1951,  was  just  opposite  to  the 
e.xperience  of  World  War  I and  World  War  II.  We  were  converting.’  service 
support  -units  to  combat  units,  both  in  Uapa.n  and  in  the  UI'. 


Then  we  converted  the.m  back  at.-;ain  for  two  reasons . ■ ne  -was  the  de- 

velopment of  a logistic  infrastr’ucture  in  Korea;  the  other  was  the  deploy- 
ment of  forces  to  E'urope  and  the  development  of  an  infrastr-uct-ure  there. 


.afte 
Tne  spike 


r the  close  of  the  .Korean  War,  there  was 
in  1956  was  an  artifact  of  the  Pentomic 


no  perceptible  trend, 
reorganization . 


I 


r. 


I 
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Then  citme  Vietnam.  Note  that  the  slope  followed  closely  the  slope 
of  World  War  I and  II.  We  were  not  in  a hurry. 

Beginning  in  1970,  we  appear  to  be  gradually  following  the  peacetime 
years  of  the  1920s  and  1930s. 

* * * * * 

Now  what  are  the  lessons  on  divisional  structures  that  can  be  drawn 
from  this  chart?  What  evaluations  should  be  made? 

EVALUATION  NEEDED 

• RESPONSE  TIME 

- MARRY -UP  WITH  PREPOSITIONED  EQUIPMENT 

- TRAINING  READINESS  vs  TRANSIT  TIME 

WITH  EQUIPMENT 

• FLEXIBILITY 

- PIECEMEAL  MOVEMENT 

- NO  INFRASTRUCTURE 


First  is  response  time.  Can  the  new  organization  marry-up  with  pre- 
positioned equipment  faster  and  more  effectively  than  the  previous 
organization?  What  are  the  requirements  for  flexibility?  No  one  likes 
piecemeal  movement  and  commitment  of  divisional  forces.  But  does  the  new 
organization  suffer  less  degradation  than  the  old  if  it  is  committed  to 
this  fashion? 


Finally,  how  does  a proposed  division  structure  compare  in  strategic 
response  time  to  a theater  with  no  infrastructure?  How  long  can  it  operate 
in  an  emergency,  such  as  Korea,  without  a large-scale  logistic  base? 

The  next  historical  trend  concerns  our  response  to  tactical  require- 
ments and  one  aspect  of  technology. 


TRENDS  19^9-1979 
ARMY  DIVISION 

Weight  X 2 
P'uel  cons'jmption(  tons  ) x 6 
A.mmo  consumption( tons ) x U 
Total  resupply (tons ) x U 

AIR  FORCE 

Tons/Sortie  x 10 


TECHNOLOGY  I9i5-1979 
(lbs  of  fuel  to  move  one  ton  one  mile) 

Cargo  aircraft  } ~ 0 2 
Wheeled  vehicles 

Tracked  vehicles  ) ^ ^ i 
Combat  aircraft 

Helicopters  ~ 1.0 


Here  we  compare  the  current  division  with  the  World  War  II  division,  on  the 
left. 


The  gross  weight  of  an  Arm;/  division  has  doubled;  the  fuel  consumption 
to  move  the  division  a given  distance  has  increased  six  times.  The  planned 
expenditure  of  ammunition  has  quadrupled — as  has  the  total  planned  resupply 
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delay;',  produot'tl  tiy  Ltic  I'eaponae  ot'  t.roop;;  to  t-he  t-hfoat  ol'  air  attiit'k  and 
repair  timer.  o!‘  liridy;ea,  ete  . , were  I'ar  more  1 pn  1 t'i  rant  than  the  aetual 
lor.r.er. . Hut  we  note  that  lu'  mothodolojo/  eurri'iitly  exiutr.  t.'  take  aet'ount 
of  there  iudireet  but  vit.al  .'ir.peet.r  o!'  eombat  operationr  'under  air  inreriority 

if  limit. t'd  nuelear  operat.ionr  oeeur,  we  belit've  t-hat  .".imilar  effect;',  will 
occur.  i'iiti  el'fort.  ti'  .'ivoid  unneceri'.ary  exporure  to  t.ai'pet  actpu;; iti on  by 
the  enemy,  tiie  enormou;-.  f’.apr  in  our  knowled;':;'  of  liuman  reaction  to  inu'lear 
effect;’.,  utui  tlu'  d i I'f  icul  t ier  and  delay;;  I'oreciu'.t.  in  a;',:'.e;'.;'.  i Hf',  the  impact  ot' 
lim,ited  nuclear  rtrike;;  on  army  force;’.,  if  tliey  .'ccur,  will  product'  uiu’t'r- 
t ain'  it';;  r.  imi  lar'  to  tht'>;'.e  iiit'Ut  i otu'ti  by  the  i'lermunr.  . 

Kx.'uiii;  1 e;i  of  net'ded  evaluat  ion;;  are  ;;liown  on  tlii;;  ;;lide. 


KVAl.UA'l'loM  NKKHKP 

- Mt'VKMKMT  tV'NTK.'I,  vr  f.i'HK.r-  .M'’  HK.'.l’t'N  'i; 

- I'lHi'Kit’A;,  AN!'  (’OMt'KAhMKk'T  v;:  KK!'' 1 1' I KMCY 

- IN'l'KtlKA'rit'N  il-i,  f.-'i,  Al’,  M!'  KUrJi"i’I OilH 

- TKt'HN01,t\:  It'AI,  ANfi  TltA  I 1 r^tl  Hl'.'.'Hi  1 HK.Mini'IV. 

If  t.lu'  manap.ement  t'f  t'l'ad  traffic  i r cent  ra  I i '.’.t'd  luul  miu’.t.  bt'  flexibit', 
wtiat  i:'.  i tr  impact  on  ;;pt'eti  t'f  rt't’.p.'iu’.t'  of  iai'fie  unit;;  an.i  re.rupply'.'  llt'W 
practit'al  i;’.  it  t.'  t'h.'uioe  the  rt'ute;;  u.reti  by  a .1  i v i ;'■  i on-;;  i .'.I'vi  unit  in  miil- 
rtre.'uri  l’t'cau:;e  t'f  air  ainl  niu'lt'iu'  thrt'at  ;’.V  What  i;;  the  impru't  .'f  niiilit 
aiiti  b.'ui-weather  nk'vementV  Wliat  art'  the  report,  i nr,  aiui  '’ttiiuiiun  i t'a  t.  i t'n  retpii  re- 
iiient;’.  t' 1'  tile  unit;;  mokinf';  t.he  mt'vement  aiui  ctf  tlie  t.rnffic  t'.'ut  r.' 1 I er;; 

P i;;per;'.a  i an.i  Ct'ncea  I meat,  t'f  li  i v i ;;  ii'tia  1 unit;;  tt'iui  tt'  int'i't'a;'.;'  rt';'.p.'n;;e 
time,  increare  tlu'  u:;t'  t't’  ra.iit',  atul  ti  i ;;pt'r;’.al  t'f  ruppt'rt  unit;'-  may  tit't'rt'a;;e 
ef  I’i  cit'iu'y  in  tlu'  ;'.en;'.e  t.liat  prt'tiut’t  i v i I y pt'r  man  i r It';;;;  and  tlie  impa.'t  I't' 
car.ual  t Le;;  (greater  . 
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Finally,  we  are  lU't  aware  t't’  an  t'va  1 ual.  it'n  t'l'  tlie  impat't  t'l'  tn'w  t.ct’h- 
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Oui-  iHSt  topic  is  rear  area  security,  'rtiis  is  closely  related  to 
the  impact  of  a serious  air  and  nuclear  threat,  with  additions. 

ALTERMTiVK  COUCLin^ 
llTHATi-lG  rc 
TACTICAL 
RKAR  AREA 

• CKCURITY  OF  RFAR  AGAINOT 
- OVKKT  THRilAT 

- COVERT  TIlRilAT  

The  major  dilemma  here  is  that  security  apainst  covert  threats — enemy 
a*.:ents,  infi  Itrators , sabotaf;',e  teams — requires  concentration.  Security 
aKainst  an  overt  threat — nuclear  strikes,  conventional  air  attack,  and  air- 
borne operations — requires  dispersal. 


REAR  ;\REA  SECURITY 

• 

AIR  THREAT 

• 

A IRROKNE/HELIBORNE  THREAT 

• 

INFILTRATORS 

• 

SABOTAGE  TEAMS 

m 

AGENTS 

• 

REFUGEES 

Enemy  a^^ents,  iine-crossers , sabotage  tesuns,  are  said  to  pose  a much 
larger  threat  to  the  US  Army  in  Europe  than  any  previous  experience  in 
Vietnan,  Korea,  or  World  War  IT.  Presumably,  the  major  objective  of  these 
elements  will  be  nuclear  units,  commiuii cat ions  centers,  and  headquarters. 

ITie  wide  frontages  existing  in  US  Army  sectors  in  Germany  tend  to  favor 
these  enemy  capabilities.  The  planned  depths  of  division  boundaries  tend 
to  increase  the  division's  requirements  for  rear  area  security.  Moreover, 
divisions  will  contain  nuclear  custodial  units,  and  corps  elements,  such  as 
IwVKCE,  and  even  PERSHING  units  may  be  located  within  divisional  areas. 

The  Soviet  Union  apparently  does  not  agree  with  the  conventional  wisdom 
that  major  airborne  operations  are  neither  feasible  nor  desirable  in  the 
face  of  NATO's  air  defenses.  They  have  increased  rather  than  decreased  the 
number  of  parachute  troops  and  increased  rather  than  decreased  the  combat 
equipment  designed  for  airdrop  or  air- landed  employment.  They  seem  to  be 
copying  and  modifying  US  heliborne  operational  concepts  of  Vietnam  and 
adapting  them  to  the  requirements  of  a theater  campaign  in  Europe. 

F’inaily,  refugees  are  an  ever-present  problem  in  any  war  fought  in  a 
densely  populated  area,  such  as  Central  Europe.  Tlie  problems  here  relate 
to  security — since  enemy  agents  can  be  among  the  refugees',  local  control — 
which  may  require  divisional  resources;  road  management;  and  sanitation, 
which  the  Soviets  discuss  in  detail.  It  is  interesting  to  note  that  no 
recent  thought  has  been  given  this  problem,  particularly  in  respect  to  the 
impact  of  refugees  on  combat  and  resupply  operations. 
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To  iuummr  i ae , wo  lioliove  tluit  ii  iiujiiIhm’  of  inipoi-Lant.  ooiioopti;  in 
eviiluatitit.';  division  force  structures  have  !iot  rt'ceived  ttie  attent  ion 
tliey  deserve.  We  iiave  discussed  tlie  five  stiown  liere. 


A.i;rHiNATlVH  KVAIAIATTON  CONfHrTd 

f.TltATKulC  MOlULITY 

L./\CK  OF  Af.flllitF.D  AIK  OUI’KHIOKITY 

OUKVIVAHILITY  UNOKH  NUCl.ijYH.'OllFMU'Al,  ATTACK 

TACTiC/U.  UNIT  MOBILITY 

KKAK  AKKA  OKOUIUTY 


Strategic  mobility  is  a dominating  fact, or  as  long,  as  t.lie  Ari^v's  ti.ir.siv'ii 
is  tc'  fight  overseas  and  as  long  as  we  cannot  plan  '-i  leisvirely  pei'iod  t't' 
preparation  and  preiiepLoyment . The  increased  wt'ight.  of  weapons  syr.teru'.  and 
the  increased  weight  of  resupply  required  foi’  tact  ical  ef I'ect  i veness  tend  ti' 
reduce  strategic  midulity.  Alternative  division  structui'cs  must  be  evaluated 
to  .1.  hieve  a balance  between  t.hese  conflicting  deiminds . vl.H.  techniques  exis.t. 
but  have  not  been  applied  to  such  an  evaluation. 

Air  superioi'ity  cannot  be  assured  in  a t'ut  ure  war  in  Oenti-al  Kurope. 
Evaluating  alternative  division  structures  in  terms  of  their  relative  viability 
involves  far  nu're  than  the  effectiveness  of  air  dei’enses.  O.K.  techtiiques 
tuid  much  of  the  require>i  data  do  not  exist  and  must,  be  developovi. 

'live  survivability  under  nuclear  luid  chemical  at.tack  of  alteiniative 
division  structures  has  tiuiny  elements  in  common  with  air  inferiority. 
fX'a.luat  ion  involves  more  than  modi  f IcatiiUis  in  the  design  of  system;',  and 
training.  O.K.  techniques  and  data  exist  but  have  not  been  applied. 

A Key  element  in  countering  .a  mimei'ical  inferiority  is  superior  t.nctical 
luiit  mi.'ibility.  Evaluating  the  t.actical  mobility  of  alterjiative  division 
structures  requires  O.K.  techniques  to  .account  for  the  imp:ict  of  0’’,  disperc.al, 
and  the  air,  chemical,  and  nuclear  threat  on  tactical  mobility. 

'llie  covert  threat  luul  the  overt  threat  from  air,  chemical,  .and  nucle.ar 
threat  and  wide  frontages  increase  the  depth  of  the  battlefield  and  the 
vulnerability  of  rear  areas.  O.K.  techniq'.ies  can  be  .adapted  to  t'valuate 
alternative  division  structures  in  ternu'.  of  the  often  conflicting  require- 
ments of  efficiency  and  survivability. 
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ABSTRACT;  This  paper  describes  some  of  the  uncertainties  and 
inadequacies  associated  with  the  analysis  of  theater  level 
wargames.  Recent  experience  in  a two  year  international  study 
pointed  out  various  problem  areas  in  data  inadequacy  and 
variability  in  military  judgement.  Factors  which  appeared  to 
affect  the  outcomes  of  the  games  are  discussed  and  a proposed 
framework  of  investigation  for  future  studies  is  proposed, 

ESTIMATED  TIME  REQUIRED  FOR  PRESENTATION;  50  minutes 
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Uncor  ta  int  ios  and  I nadeqiiac  ios  in 
Theater  Level  Combat  Analyses 
Major  Brian  R.  McKnany 
Studies,  Analysis,  and  Caminq  Aqeney 
Orqanization  of  the  Joint  Chiefs  of  Stall 


The  theme  of  this  year's  symposium  asks  us  to  "Look 
Ahead.  . . and  explore  both  applications  and  methodoloq  les 

appropriate  for  ...  OK  support  to  the  Aimy  ol  the  ROs." 

It  is  believed  by  some  with  the  present  state  ol  the  ait 
usinq  expanded  techniques  for  simulatinq  combat  in  conjunc- 
tion with  improvements  in  data  manipulation,  that  t tu'  ana- 
lyst is  now  provided  with  the  uotential  for  improved 
analyses  of  problems  such  as  net  assessment,  disarmanuMit 
options,  as  well  as  force  planninq  and  structurinq  analyst's 
by  using  theater  level  models.  This  approach  may  be  overly 
optimistic  in  light  of  uncertainties  and  inadequacies  which 
have  been  shown  to  qreatly  affect  the  results  of  such  models. 
These  uncertainties  and  inadequacies  affect  basic  assump- 
tions as  well  as  data  inputs.  However,  theater  level  qames 
offer  us  the  only  opportunity,  short  ot  actual  conflict,  to 
simulate  the  interactions  of  larqe  complex  qeneral  pin  pv^se 
forces  over  time  in  a theater  of  operations.  This  capa- 
bility is  important  enouqh  to  warrant  lurther  i nvest ioat ion. 

The  purpose  of  this  paper  is  to  identity  factois  which 
have  been  shown  to  affect  the  results  of  tlieatei  level  com- 
bat analyses.  In  so  doing  this  paper  may  tempei  the  ov>tinusm 
engendered  by  this  year's  theme  because  it  addressi's  I unaa- 
mental  problems  which  will  remain  even  as  we  proviiess  toward 
the  use  of  more  sophisticated  models  and  methodoloq ies . 
However,  it  is  not  the  purpose  of  this  papei  to  deqrade  t tie 
usefulness  of  theater  level  models  in  addressinq  the  topical 
areas  indicated  above,  but  it  is  hoped  that  at  the  conclusion 
of  this  paper  reasonable  judqments  may  be  made  by  the  leader 
concerning  how  the  results  of  such  analyses  must  be 
interpreted . 

SAGA  recently  participated  in  a joint  i n te r na t uina 1 
study  where  force  level  analyses  were  conducted  thiouuh  the 
use  of  theater  level  models. 1/  I intend  to  use  this  study  as 
a means  of  hiqhlighting  uncertainties  and  inadequacies  in 
theater  level  qames.  This  work  crystal ized  the  problems  ot 
evaluatinq  theater  level  results  in  such  a mannet  that  it 
was  felt  advisable  to  intorm  the  analytic  community  ot  Sv'mo 

1 , t u tly  on~Warsaw  Pact  and  NATO  Oonventional  Force  I'aiM- 

~ bilities,"  Phase  IV,  I MSM- J d ,1- 7 7 , May  ia;7,  ( NO  1 . 
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ot  the  problem  areas  encountered.  Durinq  the  conduct  of  the 
study,  it  became  clear  that  there  were  certain  oarameters, 
interactions,  and  data  present  which  had  a disproportionate 
ettects  on  model  results.  These  associated  uncertainties 
were  by  no  means  readily  apparent  nor  easily  solvable.  They 
were,  to  some  extent,  identified,  and  their  impact  outlined 
for  the  reader  in  the  study.  The  joint  study  pointed  out 
that  three  uaiameters  in  particular  appeared  to  affect  the 
intensity  ot  combat  in  theater  level  models.  These  were 
ates  ot  advance,  casualty  rates,  and  the  density  of  forces 
in  combat.  In  addition,  I would  add  a fourth  area,  that  of 
data  inadequacies  in  external  factors  which  affect  theater 
qames . 

Each  ot  these  areas  will  be  separately  addressed  dur- 
inq the  remainder  of  this  paper.  The  fourth  area  covers  a 
broader  perspective  where  uncertainty  exists  not  only 
because  of  the  ranqe  of  values  associated  with  individual 
data  entries,  but  also  in  assessinq  the  validity  of  measure- 
ment indices  beinq  used.  In  addition,  some  other  external 
factors  impactinq  upon  the  use  of  theater  models  are 
addressed  in  this  section. 

BACKGROUND 

First  of  all,  a definition  of  uncertainty  as  it  will 
bo  used  in  this  paper  is  necessary.  Webster's  dictionary 
states  that  it  is  a word  meaninq,  ..."a  condition  of  doubt; 
not  sure."  1 intend  to  develop  the  areas  affecting  the 
results  ot  tlioater  level  combat  analyses  listed  above,  with 
emphasis  on  ^he  doubtfulness  of  each  parameter.  In  the 
context  of  th^  definition,  the  joint  study  effort  provided 
the  following  words  on  uncertainty  in  theater  level  gaming. 
"The  spread  of  results  among  theater  level  games  may  be 
regarded  as  indicative  of  the  uncertainty  of  any  prediction 
of  duration  of  the  war  produced  by  warqames  or  analytical 
simulations  supported  by  military  judgment.  The  rates  that 
are  used  are  based  on  the  best  military  judgment  available 
and  the  results  provided  nothing  bettor  than  an  indication 
of  likely  duration  and  recognition  that  it  represents  only 
one  of  a range  of  possibilities."^/ 

The  joint  effort  mentioned  earlier  was  conducted  dur- 
ing the  period  April  1975  through  July  1977,  when  the 
results  were  briefed  to  the  NATO  Military  Committee.  This 
international  study  was  unusual,  not  because  of  its  content. 


T Working  Papers,  Study  on  Warsaw  Pact  and  NATO  Conven- 
tional Force  Capabilities,  March  1976  (S). 
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results,  nor  par t i c i non t s , but  because  of  the  methodoloq real 
approach  used.  Multiple  dynamic  models  were  used  to  evalu- 
ate the  capability  of  exist  inn  forces  in  a Central  Ruronean 
scenario.  The  three  countries  used  different  deterministic 
models,  which  used  a common  set  of  start inq  conditions  and 
data,  similar  or  identical  qaminq  rules  to  qovern  the  conduct 
of  qame  play,  and  a prescribed  set  of  measures  of  capability 
to  evaluate  their  results. 

It  was  recoqnized  early  that  the  models  resolved  combat 
at  different  levels  of  aqqreqation,  contained  different  attri- 
tion methodoloq  ies , and  employed  different  approa<'hes  to  qame 
play.  Recognition  of  these  dissimilar  approaches  led  the 
pa'ticipants  to  accent  the  idea  that  a non- i nterested  party 
was  necessary  to  evaluate  the  results.  Therefore,  the  SHAPR 
Technical  Centre  (STC)  was  tasked  to  act  in  that  capacity. 

STC  performed  an  excellent  service  for  the  study  participants 
by  evaluating  all  model  results  and  pointing  out  certain 
uncertainties  and  inadequacies  as  potential  problems  which 
must  be  investigated. 

RATES  OR  ADVANCE 


Rates  of  advance  refer  to  the  speed  at  which  forma- 
tions advance  or  withdraw  during  the  course  of  a battle 
period.  Ror  this  study  SAGA  adopted  the  rates  of  advance 
used  for  the  CRM  and  ATLAS  models  for  24  hour  battle  peri- 
ods. Being  been  placed  in  a position  of  defending  the  use 
of  such  "historical"  data,  GAGA  researched  several  studies 
purporting  to  define  and  validate  these  rates  of  advance. 

The  origin  of  these  rates  of  advance  can  be  traced  to 
papers  done  in  IRS4  by  Parson  and  Bulse,  both  of  Operations 
Research  Office  (ORO).  Parson  and  Hulse  developed  tables  of 
infantry  and  armor  battalion  hourly  rates  of  advance  against 
specific  types  of  resistance.  These  tables  were  tiien  incor- 
porated into  warqaminq  handbooks  prepared  for  the  Army  War 
College.  In  1966,  the  Historical  Research  and  Rvaluation 
Organization  (HRRO)  extracted  considerable  data  on  37  Battles 
of  WW  II  and  Korea.  HRRO  used  this  data  to  analyze  material 
replacement  policies.  Subsequently,  the  data  base  was  revised 
and  expanded  by  HRRO  for  a study  on  casualty  rates.  As  the 
initial  Parson  and  Hulse  work  showed  a linkage  between  casu- 
alty rates,  force  ratios,  and  movement,  the  Research  Analysis 
Corporation  (RAC)  used  the  HRRO  data  base  to  conduct  an  in- 
house  study  in  an  attempt  to  derive  insights  and  validate  the 
existing  rates  ot  advance  and  force  ratio  tables  used  in 
war names . 1 


1 ' Wa insteTn , L, '^Progress  Report  on  Historical  Data  tor  Gimu- 
~ lations,"  wr-9,  Institute  for  Defense  Analyses,  l'^72.  P.  1- 


Althouqh  it  appeared  that  adequate  empirical  evidence 
was  availaDle  to  develop  the  rates  of  advance  tables, 
several  recent  studies  have  cast  doubt  upon  their  validity. 
Leonard  Wainstein,  in  an  Institute  for  Defense  Analyses 
report,  states  that  . . . "the  two  studies  were  rouqh,  hasty 

efforts,  inputs  to  a study,  not  careful  pieces  of  research 
. . . numerous  specified  and  unspecified  qualifications  sur- 

rounding the  data  have  been  overlooked  . . . the  variation 
amonq  tlif'  sizes  of  the  sample  units  examined  in  both  papers 
makes  questionable  their  qeneralized  findinqs."l_  Secondly, 
MLRO,  once  a proponent  of  a linkaqe  between  force  ratios  and 
rates  of  advance,  no  lonqer  holds  that  opinion. 2'  Further 
validation  efforts  on  the  force  ratio  linkaqe  cont i nued  with 
a study  done  by  VKRTKX  in  1974  usinq  historical  data  extracted 
from  the  Lorraine  and  Ardennes  offensives. 2 This  same  data 

was  qiven  to  the  University  of  London  last  year  by  the  SHAPE 
Technical  Centre.  The  University  was  charqed  to  determine 
if  any  raeaninqful  r e 1 a t ionsh ios  exist  in  the  data  which 
links  force  ratios  to  the  advance  of  forces,  mechanized  or 
infantry.  The  results:  "No  discernible  relationship  could 
be  determined  usinq  statistical  analysis--there  was  too  much 
noise  in  the  data. "4/ 

Consequently,  rates  of  advance  tied  to  force  ratios  used 
in  a whole  qeneration  of  qaminq  models  appear  to  be  without 
loqical  or  historical  basis.  However,  there  is  some  expected 
ranqe  of  value  within  which  these  rates  of  advance  exist. 
Questions  concerninq  the  validity  and  use  of  such  factors 
represent  an  uncertainty  in  the  evaluation  of  model  outcomes. 
If  the  movement  of  the  FEHA  is  the  Svile  measure  of  effective- 
ness used,  the  determation  of  adequate  rates  to  simulate  the 
movement  of  formations  is  crucial  tor  valid  assessments  of 
divisional  and  theater  level  conflicts. 

CASUALTY  RATES 


The  joint  study  also  pointed  out  that  differences  in 
casualty  rates  were  a second  factor  which  affected  the  inten- 
sity of  combat.  Research  in  this  area  led  us  to  investiqate 


^ Wainstein,  L,  ""An  Examination  of  the  Parson  and  Hulse 
Paper  on  Rates  of  Advance",  IDA  Report  P-991,  Dec  1973. 

2/  Dupuy,  T.N.,  Response  to  SAGA  Opinion  Survey,  June  1976. 

7/  Cockrell,  J.K.,  "Research  Study  on  Predictive  War  Game 
Factors,"  RMC-VERTEX  Corporation,  STC  Contract  C-72-03, 
March  19  73  . 

4/  Goaii,  R.  , Comments  made  to  author  durinq  meetinqs  con- 
ducted on  the  Study  on  Warsaw  Pact  and  NATO  Conventional 
Force  Capabilities,  March  1977. 


areas  ot  uiioe  t t a i ti  t y in  more  than  just  attrition.  Attrition 
rates  are  ileve  loped  in  several  ways  dependin'?  upon  the  level 
ot  tesolution  ot  the  model  beinq  used.  Theater  level  models 
Sutter  trom  a reouirement  to  aqqregate  the  eftects  ot  high 
resolution  simulations.  J.A.  Stockfisch,  in  a recent  Rand 
Report,  treats  this  problem  in  terms  ot  levels  of  abstrac- 
tion. A high  resolution  model,  in  order  to  be  manageable, 
is  abstracted  trom  the  larger  context  of  an  engagement.  A 
hierarchy  is  established  in  some  manner  where  some  analytic 
and  some  judgemental  outputs  from  one  model  are  treated  as 
inputs  to  another. V Hence,  some  means  of  assessing  the 
results  of  high  resolution  attrition  in  the  context  of 
theater  wartare  is  required. 

The  current  operational  theater  level  models  generally 
employ  several  means  of  using  aggregated  data  for  assessing 
attrition  to  large  units.  First,  the  so-called  "historical" 
approach  places  emphasis  on  measuring  changes  in  ooposing 
force  ratios  in  order  to  provide  an  entry  to  personnel  casu- 
alty tables.  Secondly,  entry  values  to  attrition  tables  are 
determined  by  calcula*^ing  a proxy  variable  or  index.  This 
technique  requires  a calibration  to  adjust  the  model  output 
to  a set  of  known  corulitions.  Finally,  a hieratchial  chain 
may  be  established  to  pass  the  results  ot  attrition  progres- 
sively from  lower  to  higher  unit  levels.  This  chain  may  be 
composed  of  a series  of  models  or  may  be  internal Iv  generated 
in  one  model. 

Among  these  three  possible  methods,  military  judgement 
has  most  often  been  used  to  fill  gaps  in  historical  data;  to 
decide  what  weaoon  will  tire  at  another;  to  develop  weighting 
schemes  whereby  heterogenous  weaoon  systems  are  converted  to 
a common  additive  base,  and  to  j udgemen t a 1 1 y determine  what 
data  is  passed  trom  one  model  to  the  next  in  a hierarchy. 

This  is  by  no  means  an  all  encompassing  list.  Therefore,  1 
feel  that  it  is  a fair  statement  that  some  form  of  military 
]udgement  can  be  found  at  every  level  where  data  is  collected 
or  manipulated  to  establisii  the  basic  aggregate'!  attrition 
effects  used  in  theater  level  models. 

The  first  experimental  results  evaluated  during  the 
international  study  showed  that  variances  between  gam.es  could 
be  traced  to  several  factors.  The  first  key  to  differences 
in  casualty  rates  was  indicated  by  aoparently  different 
impressions  ot  what  constitutes  high  intensity  combat.  Many 
other  analytical  agencies  suffer  in  this  re';ard  by  stating 

T~^Stock  f Isch , ..TA.  "Models,  Pata,  and  War:  A '.'ritigue  on 
the  Study  of  Conventional  Forces",  Rand  Report  R-l^Ct-PK 
March  1'175,  Pg  ‘1. 


that  their  model  or  their  studies  used  the  Middle  Hast  con- 
flict of  I'lTJ  as  a basis  for  estimatinq  battle  intensity. 

I’tiis  conflict  emphasizes  the  qreater  attrition  rates  expected 
ot  modern  weapon  systems.  It  was  our  misfortune,  initially, 
to  discover  that  while  all  three  study  participants  said 
they  based  their  model  calibration  on  Middle  Kast  data,  each 
fiad  selected  a different  conflict  period  as  their  base.  Con- 
sequently, the  term  "cal  ibrateil  to  Middle  Kast  experience". 
Itself  connotes  some  measure  of  uncertainty. 

SAC, A attempted  to  resolve  this  issue  by  concent  rat  i nq 
on  improvinq  the  exist inq  methodoloqy  for  assessinq  attri- 
tion used  in  the  IDAGAM  model.  The  STC  had  earlier  pointed 
out  tnat  each  model  used  a different  attrition  methodoloqy 
and,  all  used  a Lanchester  formulation  in  obtain  final 
results.  The  SAGA  methodoloqy  was  based  upon  a technique 
which  used  ideal  linear  weiqhts  for  expressinq  the  value  of 
weapons  systems.  This  approach  was  developed  by  the  Institute 
for  Defense  Analyses  (IDA).  Calibration  of  the  model  was 
necessary  because  its  basic  assumptions  required  that  some 
form  of  scalinq  be  made  to  convert  potential  casualties  to 
actual  casualties.!^/  However,  the  initial  calibration  basis 
was  not  clearly  prescribed  causinq  some  measwre  of  confusion. 

In  the  Army  COMCAP  Study  (1973),  the  potential  kills 
were  related  to  actual  kills  by  a scalinq  factor  (i.e.,  the 
expected  weapon  kill  probabi 1 i t les  at  specified  ranqes  are 
to  be  interpreted  as  potential  kill  probabilities,  but  that 
there  exists  a "foq  of  war"  wliich  may  deqrade  this  capability 
such  that  actual  losses  are  somewliat  less).^/  SAGA  prepared 
an  opinion  survey  keyed  to  estimatinq  losses  in  a European 
scenario  in  order  to  establish  a revised  scalinq  factor  to 
be  used  in  IDAGAM  for  the  joint  study 

The  results  of  this  survey,  conducted  durinq  the  summer 
of  197b,  formed  the  basis  for  calibration  of  the  IDAGAM  model. 
The  survey  showed  that  mil  i tar  y’  judqment  , per  se , is  a varia- 
ble which  should  be  treated  as  an  uncertainty.  The  pure 
military  judqment  answers  by  military  historians,  senior 
commanders.  War  Colleqe  students,  analysts,  and  operations 
and  staff  officers  were  used  to  construct  the  scalinq  factor 
for  losses.  Model  results  could  then  be  assessed  usinq  a 
contidence  interval  developed  from  the  survey  answers. 


2 AnJerson,  E.P.,  et^  IDA  Ground-Air  Model  I (IDAGAM), 

Vol  I,  Comprehensive  Description,  Institute  for  Defense 
Analyses,  Oct  1974,  p.  47. 

2/  Holter,  W,  Appendix  D,  NATO  Combat  Capabilities  Study 
(COM'AP  II)  1973  (S),  Appendix  D is  unclassified. 
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The  variability  in  military  jiidqement  was  also  noted 
by  another  study  participant  when  they  used  an  opinion 
survey  to  revise  certain  planninq  estimates  affectinq  the 
tactical  deployments  of  forces.  This  survey  also  allowed  a 
confidence  interval  to  be  constructed.  Results  produced  by 
Its  model  were  later  evaluated  usinq  this  confidence 
inter  val.J^/ 

An  interest  inq  and  thouqht  provokinq  analysis  ot  the 
use  of  models  incor por at inq  judqmental  inputs,  as  well  as 
those  developed  from  analytic  means,  was  incorporated  into 
the  Rand  Report  cited  earlier.  It  should  be  required  read- 
inq  for  all  new  theater  level  "modeleers".  In  it,  Stockfisch 
states  that  the  variability  inherent  in  much  of  the  judqe- 
mental  data  provided  foi  use  in  theater  level  models  produces 
results  which  become  "...  state  histories  as  hypotheses  in 
the  scientific  meaninq  of  the  word.  At  a minimum  they  are 
are  creatures  of  both  the  model  and  the  set  of  data  fed  into 
the  mode  1 " . 2/ 

To  summarize;  different  impressions  of  the  intensity 
of  combat  produced  variances  in  the  results  of  these  theater 
level  qames.  Rates  of  advance  and  casualty  rates  both  con- 
tributed to  these  different  impressions.  Military  judqment 
has  been  shown  to  play  a considerable  oart  in  the  derivation 
and  development  of  much  of  the  attrition  data  which  is  used 
in  theater  level  models. 

DENSITY  OF  FORCES 


The  third  area  which  affected  the  intensity  of  combat, 
was  the  density  of  forces  in  contact.  This  parameter  has 
been  observed  to  be  affected  by  several  interactions  which 
have  both  judqemental  and  analytic  foundations. 

The  density  of  forces  is  affected  by  the  rate  of 
tactical  commitment  of  forces  into  battle.  This  was  seen 
as  a judgemental  effect  in  the  joint  study.  The  early  com- 
mitment of  large  numbers  of  forces  creates  massive  th-^ater 
resource  allocation  problems.  The  slower  the  rate  of  com- 
mitment, the  easier  it  is  for  the  theater  and  corps  com- 
manders to  replace  losses,  resupply,  and  allocate  reserve 
forces  to  critical  areas.  Density  of  forces  is  also  linked 
to  casualty  rates.  The  more  forces  in  contact  the  higher 
the  force  ratio,  and  higher  attrition  should  be  observed. 


T"”  Working  papers,  "Study  on  Warsaw  Fact  and  NATO  Conven- 
tional Force  Capabilities,"  Sept  l'^76.  (S) 

2/  Stockfisch,  J.A.,  » p 2^. 
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To  the  extent  that  improved  technoloyy  creates  exchange 
ratios  of  two  and  three  to  one,  for  the  defender,  the  forces 
in  contact  should  remain  small.  However,  there  is  a point 
wnere  quantity  overrides  quality  and  the  Lanchester  effects 
of  mass  govern  the  losses  incurred  by  the  smaller  force  and 
allows  a large  number  of  units  to  be  in  contact. 

Anotner  military  ]udgement  decision  specifies  which  for- 
ces may  come  in  contact.  In  particular,  the  number  of 
tactical  positions  planned  to  be  occupied  during  a battle 
period  can  increase  or  decrease  the  density  of  forces  in 
con  tact. 

There  is  also  an  inherent  problem  in  that  most  theater 
level  models  play  only  one  set  of  tactics.  Simulations  of 
theater  warfare  using  only  one  tactic  incorrectly  estimate 
the  true  capabilities  of  the  forces  involved  if  different 
concepts  of  execution  of  the  conduct  of  the  defense  or 
offense  exist.  In  addition,  the  employment  of  one  set  of 
tactics  implies  that  standardization  of  forces  exists.  This 
assumption  may  be  a driving  factor  in  studies  which  address 
contrained  supply  levels. 

I am  also  convinced  that  we  too  often  employ  or  commit 
opposing  forces  based  upon  i^estern  military  judgments,  rather 
than  upon  aggressor  tactics.  Tnis  is  exacerbated  by  intelli- 
gence agencies  which  provide  force  laydowns  which  meet  model 
input  requirements,  but  are  caveated  to  the  extent  that  the 
force  deployments  may  not  be  in  accordance  with  aggressor 
intentions.  The  uncertai.ity  which  one  must  associate  with 
intelligence  inputs  is  also  true  of  several  external  factors. 
These  points  are  examined  in  the  next  section. 

EXTERNAL  INADQUACIES 

This  area  encompasses  problems  of  uncertainty  and  inad- 
equacies in  model  inputs  and  the  treatment  of  factors  external 
to  the  model  framework.  Considerable  effort  and  resources 
are  now  oeing  expended  in  the  development  of  large  scale  data 
bases  for  the  newer  theater  models.  J.N.D.  Gupta  in  a recent 
article  in  INTERFACES  states:  . . the  usual  belief  is 

that  data  requirements  are  dictated  by  the  model  and  that  the 
data  exists  some  place.  It  is  true  that  the  usability  of  data 
13  determined  by  the  model,  but  the  model  does  not  provide 
data."!./  This  is  true  of  the  current  generation  of  theater 
level  models  and  it  will  become  a more  acute  problem  as  data 
requirements  expand  with  newer  models. 

1/  Gupti,  J.N.D. , "Management  Science  Implementation: 

Experiences  of  a Practicing  Manager,"  INTERFACES 

Vol  7,  Number  3,  May  19''7,  pg . 88. 
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The  US  has  relied  heavily  upon  historical  and  empir- 
ical data  in  order  to  develop  inputs  for  theater  level 
games.  Wainstein  pointed  out  that  there  is  a paucity  of 
continuing  historical  research  to  determine  planning  fac- 
tors for  large  unit  operations.  The  limited  efforts  at 
data  generation  using  actual  records  on  WW  II  are  compli- 
cated since,  for  the  majority  of  battles,  data  is  spotty  or 
inadequate  and  its  extraction  has  been  time  consuming  and 
expensive.  Equal  treatment  of  opposing  forces  is  compli- 
cated because  all  the  German  records  were  returned  to  Bonn 
a few  years  ago.  As  a result  of  the  effort  required  to 
extract  relevant  model  oriented  data,  many  studies  have 
relied  upon  the  same  set  of  historical  data.  Hence, 
relationships  may  exist,  such  as  in  the  tenuously  empir- 
ical basis  of  rates  of  advance  factors,  which  have  limited 
foundation  in  empirical  evidence. _!/  I would  point  out 
that  the  above  conditions  still  exist.  Furthermore,  the 
condition  exists  without  definition  of  the  bounds  of 
uncertainty  surrounding  the  data  used. 

Stockfisch  points  out  that  . . . "any  number  when  con- 
fronted by  an  analyst,  decision  maker,  or  other  interested 
party,  should  be  probed.  . . ."2/  It  is  in  the  best 
interests  of  all  concerned  if  it  can  be  determined  whether 
the  number  was  based  upon  empirical  evidence  or  military 
judgment,  but  it  begs  further  analysis  whether  judgmental 
or  analytic  derivations  provide  the  best  source  of  data  for 
games.  This  problem  is  compounded  because  there  are  con- 
flicting theories  among  analysts  concerning  the  applicability 
of  historical  and  empirical  analysis  to  simulations  of  modern 
warfare.  It  is  not  the  purpose  of  this  paper  to  degrade  the 
use  of  one  or  the  other  approaches,  only  to  point  out  that 
both  have  associated  uncertainties  and  m.ust  be  treated 
accordingly.  The  manipulation  of  numbers  into  measures  of 
capabilities  (MOC)  allows  connotations  of  military  effec- 
tiveness to  be  drawn  by  analysts  which  are  based  on  single 
point  estimates.  These  indices,  normally,  are  drawn  from 
Changes  in  proxy  variables.  Such  indices  are  only  surrogates 
for  reality  and  are  abstractions  of  combat  used  for  conveni- 
ence and  manageability.  The  uncertainty  in  the  numbers 
raise  questions  on  the  validity  of  well  known  indices  as 
being  truly  reflective  of  reality.  The  uncertainty  associ- 
ated with  the  development  of  most  deterministic  data  used  in 
theater  models  should  be  clear  at  this  point.  Nonetheless, 


i/  Wainstein,  L,  WP-9,  "Progress  Report  on  Historical 
~ Data  for  Simulation,"  Institute  for  Defense  Analysis, 
January  1972,  pg.  1-4. 

2/  Ibid,  pg . 6. 
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».’ONCLUS  IONS 


Th«'  Luu't't  taint  u's  ulont  it  U'vi  in  thin  papni  nhoulO 
tt'inpiM  noiiit'  ol  t(ii>  optimiiiiii  t'lMfinini  cii  hy  t ho  t'otontial 
usaqo  of  tfioatt'i  moitol;; . It  shouKt  also  ho  i ('inoiutt- 

orod  that  no  mattoi  lu'w  liotaiUni,  a modo  1 oan  not  yot 
nimiilate  t fio  mont  oiitioal  taotoi;;  loooonizoii  hv  sonioi 
coinmandot  s , luimoly  1 1 a i n i lu) , moialo,  and  1 o.ido  i mIi  i p . I 
would  vontuti'  to  aay  that  unt  il  nuoh  t imo  that  sut  t louMit 
of  fort  It;  filaood  upon  lotiolvinu  f h<'  uiu'oitainty  laotoi:; 
Idontifiod,  t ho  roniilt;;  ot  thoatoi  lovol  uamo.-;  usoii  to 
ovaluato  ttiono  topioal  aioat;  will  in'Ovt  to  lu'  qualil  lod. 


ilowovoi  , t fu'  piudtMif  U!;i'  ol  thoatoi  moili'ln  in  oxamininu 
tho  vai  lout;  anpooti;  vit  not  asm'nnmont  , d i nai  nianu'n  t option;; 
and  loroe  p’anniiu)  oan  I'lovido  a ouido  to  tho  iooinion  maki'i  . 
Tfio  rooounifion  tliat  unooitainty  oxi::t;;  in  ;;ovoial  ki'y  ait'a:; 
oan  f'o  addt  ontu'd  vtui  ino  tho  oonoojitual  }dia:;o  ;it  any  r.tudy. 

It  in  nuffioiont  to  idontily  oxout  i ont;  oi  ;;on;;  1 1 i v 1 1 y 
analytics  wliioh  hound  t fio  koy  atoa;;  altootinu  tin'  intoiniily 
ot  ooiiihat  . In  t tio  tutuio,  unoot  t a i nt  i os  will  not  oo  away 
simply  by  huildiiuj  t>oftoi  mous.o  t t ap;; . Sinoo  tho  [uoji'otod 
modols  ii'iiuiio  s ion  1 I u-ant  1 y moi  data  than  t lio  ouiiont 
modo  I , tho  i isk:;  a;;:;o^' i at  od  with  not  i nvt'S  t i oa  t i no  tho 
sons  1 1 1 V 1 1 lot;  ot  fiatamotois  oausino  unooitainty  may  hooomo 
unaooopt  ati  1 o . 


In  addition  to  f'lovidino  t'vnnui;;  upon  unooitainty  in 
areas  of  i nvos  t i via  t i on  , a stiuiy  t vi  ilo  t <' i m i no  appi  opi  lato 
1 atos  at  whioh  toimat  tons  movo  in  oomhat  is  ab.';i'>  1 ut  o 1 y 
t'ssontivil  to  im()tiivo  ttu'.iti'i  It'vol  iiuido  1 s . In  tho  noai 
tuturo  two  major  tioKi  tosts  ato  to  tioviin.  I n;;t  t umont  at  i>'n 
oan  bo  i noor  poi  a t ovl  in  ttu';;;'  tosts  whioh  may  oajit  ui  o tin' 
nooost;ary  roquiiovl  vlata.  While  vinly  bt'  a i nn  i no  , it 
would  diroot  iittontion  to  oiitioal  ai  oa:;  vi  I unooitainty 
wtiioh  arc  important  to  tho  analytio  ovinimun  i t y . 

In  my  opinion,  t tu'  bi'St  u;;<'  ot  thoatoi  movlol;;  will  bo 
to  providt'  a moans  ot  assos;;ino  lolativo  v'haiivios  in  woll 
dotinoil  areas  iit  i nvt's  t i via  t i on  . It  must  bo  t'mph.is  i .-.ovl 
aoain  that  tho  our  rent  aiul  pioji'otod  moiiol;-,  sluuiKl  imt  bo 
used  to  provide  siisilo  pi  ovl  i I't  i viiis  ol  oontliv-t  vuiti-v'iiK'.  vin 
tho  othoi  h.ind,  ii'Kitivo  olnnivio:;  o>in  bo  ovaluafovi  by  tho  use 
of  troiiil  .iiivilysis  t Ov'hn  i v]uo:;  usin>i  mull  iplo,  lathoi  than 
sinqlo,  moasuros  ol  I'aiib i 1 1 1 y . 

It  is  hoped  tluit  the  i ouvlot  , in  liviht  v'l  tho  above  vl  i s- 
oussions  will  tool  more  oomtoi  table  in  i n t o i pi  <' t i lui  tho  losult 
of  thoatoi  oombat  .inalysi's.  SAdA  has  initialovi  a now  i tinly  tv'' 
support  tho  vlovi' 1 iipmon t ol  tho  vK'int  Sti.ito.iio  Obioolivo  Plan 
(vlStiP).  It  is  a il«'vo  1 v''pmon  t a 1 otlviit  whoii'  Sv'iiU'  v'l  tho  abv'vi' 


uncertainties  in  force  planninq  may  be  quantified  and  the 
decision  makers  made  aware  of  their  impact  upon  the  develop- 
ment of  force  requirements  for  Central  Europe.  The  method- 
oloqy  and  model  to  be  used  for  this  study  will  capitalize  on 
the  observations  and  efforts  of  the  recent  international  study. 
Its  successtul  conclusion  will,  hopefully,  provide  a better 
appreciation  of  uncertainty  and  risk  in  selected  areas  of 
force  planninq.  It  may  provide  an  excellent  basis  from  which 
we  can  return  aqain  to  this  forum  in  the  future 
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A Proposed  Probabilistic  Monte  Carlo  Analogue  Concept 
Herbert  N.  Cohen 

US  Army  Concepts  Analysis  Agency 


1.  BACKGROUND.  The  purpose  of  this  study  is  to  develop  a credible  a' a- 
lytic  model  that  would  handle  combat  between  opposing  Red  and  Blue  divi- 
sions involving  many  kinds  of  weapon  systems.  Typically,  these  involved 
hundreds  of  tanks  and  light  armored  vehicles.  Vehicle  and  ground  mounted 
anti  tank  weapons,  helicopters  and  artillery  were  also  included  in  the 
mix  of  weapons.  It  was  considered  desirable  that  the  model  be  capable 
of  standing  alone  and  not  have  to  rely  on  other  engagement  or  battle  mo- 
dels. Another  specification  was  that  it  be  fast  running.  Since  Monte 
Carlo  methodologies  did  not  satisfy  these  requirements,  an  analogue  of  a 
Monte  Carlo  concept  was  developed  for  handling  fairly  complex  probability 
problems  involving  time  dependent  events  in  a rather  straight  forward 
routine  manner.  Ihe  analytic  form  of  the  attrition  equations  allowed 
them  to  be  programed  on  a small  hand  held  electronic  calculator.  It  was 
suggested  that  the  probability  methodology  needed  to  be  presented  in 
terms  of  a challenging  real  problem  if  it  were  to  be  meaningful  and  con- 
vincing. The  methodology  will  therefore  be  applied  within  the  context  of 
the  analytical  combat  model  referred  to  earlier.  Model  development  to 
date  has  been  restricted  to  weapons  firing  at  other  weapons,  rather  than 
being  fired  at  area  targets  in  an  indirect  fire  mode. 

2.  DISCUSSION.  Important  effects  from  reaction  times,  flight  times, 
time  between  shots,  single  shot  kill  and  survival  probabilities  of  the 
targets  and  the  firers,  the  number  of  shots,  the  probabilities  of  terrain 
line  of  sight,  detection  and  acquisition,  the  combinations  of  weapon 
types  in  each  sub-engagement,  and  the  numbers  of  sub-engagements  (which 
are  obtained  from  using  targeting  rules  to  be  described  later)  have  been 
incorporated  into  the  probability  equations. (Symbols  are  described  in 
Figures  13-16). 

a.  Attrition  Results.  Figure  1 titled,  "Examples  of  Attrition  With 
Reinforcement,"  shows  the  fraction  of  surviving  weapons  with  time  for  Red 
and  Blue  weapon  types  and  varying  percentages  of  reinforcement  based  upon 
the  initial  quantities.  Fighting  is  assumed  to  continue  during  the  rein- 
forcement period.  As  would  be  expected,  the  fraction  surviving  (based 
upon  the  initial  quantity)  shows  an  increase  during  the  time  that  weapons 
are  being  added. 

b.  Basic  Attrition  Equations  With  Reinforcement.  The  equations  in 
Figure  2 present  the  rationale  of  the  model.  The  formulation  is  simply 
expressed  by  the  first  equation  which  basically  states  that  the  differen- 
tial decrease  in  the  number  of  surviving  weapons  of  type  N is  equal  to 
the  attrition  loss  minus  the  number  gain  by  reinforcement.  The  attrition 
loss  is  the  loss  per  engagement  multiplied  by  the  number  of  engagements 
per  battle.  The  latter  term  is  the  number  of  weapons  per  battle  divided 
by  the  numbers  per  engagement.  Dividing  by  the  time  per  battle  TPB  gives 
the  loss  per  unit  time  and  multiplying  by  dt  results  in  the  differential 
loss  in  dt  time.  The  replacement  fraction  RF,^  is  multiplied  by  the  in- 
itial number  NU^(o)  giving  the  absolute  number  replaced.  Dividing  by 
TFR,  the  time  for  replacement  results  in  the  number  replaced  per  unit 


iru 


link'.  Multiplying  hy  (It  results  in  the  nuMiher  replaced  in  clt  time.  L 
and  R are  the  loss  and  replacement  rates  used  over  the  integration  inter- 
val. If  1 and  R chaiuie  appreciably,  new  values  may  he  used  in  a subse- 
quent integration  interval,  startirui  witti  a new  value  of  time,  ti.  Ihe 
equation  is  a modified  version  of  the  lanctiester  equation.  Ihe  nvnlitica- 
tions  have  allowed  us  to  obtain  the  coetfuients  from  the  tarqetinq  and 
probability  methodolocjy  described  below  tor  combined  arms  combat. 

c.  T_ar(jetinci  Scheme.  To  determine  attrition  by  means  of  the  above 
equation,  it  must  first  be  detei'iiiined  wtio  is  shootinci  at  whom,  for  all 
the  weapon  systems.  It  was  assumed  that  the  dt'tense  targeted  and  fired 
first.  The  target  priority  was  based  on  those  weapons  which  were  the 
greatest  threat  to  the  defense,  llie  defense  then  used  those  weapons 
which  had  the  highest  probability  of  kill  against  the  target  priority 
list  previously  selected  by  the  defense.  Ihe  offense  fired  back  at  those 
weapons  that  were  targeting  it.  Ihe  offense  targeted  its  remaining  wea- 
pons  using  the  same  rules. 

d.  T_ar(j^in(j  Results.  Figure  3 titled,  "Ingagement  Targeting  Re- 
sults," shews  the  results  of  the  above  targeting  rules.  (Double  digit 
numbers  ending  in  1 or  3 represent  different  weapon  types  on  the  defense 

and  offense  side  respectively.)  Ihe  rules  were  applied  over  a ligtit  and  ■ | 

heavy  combat  sector.  Sever'al  variations  of  the  rules  were  also  tried.  t ' 

The  figure  shows  that  the  majority  of  sub-engagements  were  1 vs  1,  with  • i 

some  1 vs  2 and  2 vs  ? types.  These  and  more  complicated  types  of  sub-  ' J 

engagements  will  be  discussed  below.  > 

e.  Application  of  ProbabilUy  Methodology.  Figure  4 titled,  "Prob- 
ability Application,"  illustrates  the  concept  when  it  is  applied  to  de- 
termining the  probability  of  a given  round  (the  third  round,  for  evample) 
from  weapon  3 killing  weapon  b when  both  weapon  b and  weapon  b are  firing 
at  weapon  3,  thus  affecting  its  probability  of  killing  weapon  b.  Ihe 
single  shot  survival  and  kill  probabilities  of  each  round  is  allowed  to 
vary  from  shot  to  shot.  If  the  firing  times  for  each  weapon  and  the  time 
of  flight  of  each  round  have  already  been  determined,  then  an  event  se- 
quence can  be  sot  up  as  shown  in  ttie  figure.  The  figure  lists  the  four 
basic  requirements  that  must  be  satisfied  to  solve  the  problem.  The  sur- 
vivability and  kill  probability  terms  that  must  be  included  and  those 
that  are  not  pertinent  follow  directly  frc'iii  the  basic  requirements  wfiich 
are  shown  in  parenthesis  next  to  the  teniis  in  the  solution.  The  solution 
for  the  kill  probability  based  upon  the  three  participants  is  not  the 
conventional  binomial  expression.  It  involves  specific  contributions 
from  all  three  participants;  and  is  independent  of  the  kill  probability 
value  of  the  second  and  all  subsequent  shots  fired  by  weapon  b at  weapon 
3.  This  is  because  these  shots  arrive  at  weapon  3 after  the  killing  shot 
from  weapon  3 is  £ired.  Probabi 1 i tv  of  line  of  sight,  detection  and  ac- 
quisition, are  handled  as  shown  in  the  figure.  It  is  assumed  that  previ- 
ous specific  random  events  do  not  influence  subsequent  random  events. 

The  frequency  of  specific  subsequent  random  events  is  influenced  only  by 
the  probability  associated  with  the  event  at  the  specific  time  in  the 
event  sequence.  These  probabilities  may  however  vary  from  shot  to  shot. 

Figure  b is  an  additional  example  of  the  method  tor  a 4 by  4 sub-engage- 
ment. Much  lengthier  and  complex  sequences  would  require  more  steps  and 
possibly  computer  solution  to  obtain  final  analytic  foniiulaes.  Since  the 


actual  problem  we  were  solving  involved  developing  an  analytic  model  of 
combat  and  putting  it  into  a hand  held  calculator  it  was  decided  to  make 
certain  simplifying  but  acceptable  assumptions.  Once  this  was  done,  it 
was  possible  to  develop  equations  which  satisfied  the  basic  survivaiii'- 
ity,  kill  and  calculation  requirements  discussed  above. 

f.  Mechanization  of  Probability  Computation.  The  firing  times  J'  ' 
flight  times  are  still  allowed  to  be  different  tor  each  weapon.  Ihe 
first  equation  in  Figure  b expresses  analytically  the  result  obtavuvi 
previously  where  a sequence  of  events  chain  had  to  be  set  up  for  eacH 
problem.  The  latter  is  tedious  and  time  Consuming  unless  it  wore  done  on 
a computer.  To  make  the  problem  more  manageable,  it  was  assumed  tnat  t' 
time  between  shots  and  the  flight  times  did  not  vary  from  shot  lo  snot. 

In  addition  the  kill  probability  of  each  arrivir.y  shot  was  assumed  to  be 
constant.  These  assumptions  reduced  the  amount  of  input  data  that  had  to 
be  handled  by  a very  significant  amount.  It  was  now  possible  to  auto- 
matically calculate  which  probability  terms  needed  to  be  included  for 
each  participant  in  the  sub-engagement.  The  required  value  of  the  expo- 
nent is  now  calculated  by  the  last  equation  shown  in  the  figure.  For  any 
desired  value  of  the  killing  shot  fired  from  weapon  3 or  M,  the  equation 
calculates  the  number  of  shots  from  N or  N'  that  would  arrive  at  M £ricr 
to  the  killing  shot  being  fired.  The  attritor  must  survive  these  numbers 
of  shots  to  kill  with  its  next  shot.  The  lowest  integer  term,  (not  al- 
lowed to  be  negative)  insures  that  we  use  only  integer  numbers  of  arriv- 

ing shots.  Another  constraint,  not  shown  in  the  figure,  is  that 

not  exceed  the  number  of  shots  available  to  N'  for  firing  at  M.  Figure  7 

generalizes  the  previous  case  for  2 vs  2 type  combat.  It  shows  how  the 

loss  coefficient  L for  the  basic  attrition  equation  may  be  calculated 
from  input  and  previously  derived  values.  It  is  assumed  that  the  prob- 
ability of  weapon  N surviving  shots  from  M is  independent  of  the  prob- 
ability of  weapon  N surviving  shots  from  weapon  M’ . 

g.  Sensi ti vi ty . Figure  8 shows  the  sensitivity  of  the  Probability  of 

Kill  per  Target,  PKPTT(N)  to  some  of  the  28  independent  variables  in- 
volved in  a 2 X 2 sub-engagement.  The  first  colunn  showing  nominal  val- 
ues of  some  of  the  major  variables  results  in  a probability  of  kill  of 

target  N equal  to  0.1.  This  is  because  the  4 rounds  from  N and  N'  arrive 
at  M before  M can  fire  its  round  at  N.  (If  there  is  no  entry  in  a subse- 
quent column,  the  value  reverts  to  the  nominal  value  in  the  first 
column.)  Increasing  the  time  to  fire  from  N to  M from  0 to  20  seconds 
increases  the  probability  of  killing  N to  only  .11  since  the  rounds  from 
N'  are  still  able  to  arrive  in  time  to  prevent  M from  firing  at  M.  When 
the  time  of  flight  for  N'  is  also  increased  to  20  seconds,  the  probabil- 
ity of  killing  N increases  to  .99  as  would  be  expected.  Decreasing  the 
probability  of  kill  by  N and  N'  of  M to  .01  (from  .7)  increases  the  prob- 
ability of  killing  N from  .1  to  .92.  If  the  time  to  fire  from  N and  N' 
to  M is  made  1 second  compared  to  0 seconds  from  M to  N,  then  M can  fire 
its  round  before  it  is  killed  and  the  probability  of  kill  of  M is  in- 
creased from  .1  to  .99.  Similarly,  decreasing  the  probability  of  line  of 
sight  from  N to  M and  from  N'  to  M to  .b  increases  the  probability  of 
kill  of  N from  .1  to  .52.  Figures  9 and  10  present  additional  sensitivi- 
ties, with  all  the  nominal  values  specified  in  the  first  column,  ‘iotes 
at  the  bottom  of  these  two  figures  give  a short  physical  explaration  of 
each  effect.  The  input  values  used  in  these  figures  and  other  parts  of 
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the  report  are  chosen  to  show  responsiveness  of  the  model  and  do  not  nec- 
essarily bear  any  resemblance  to  actual  weapon  system  values.  Each  col- 
umn represents  another  JO  second  run  on  the  hand  calculator.  The  results 
show  that  the  model  perfonns  as  would  be  expected  for  each  of  the  input 
variables.  Figure  11  relates  PKPTT{n)  to  the  fraction  of  weapon  systems 
surviving,  based  upon  the  initial  number  when  combat  started.  It  may  be 
noted  that  the  fraction  that  survives  is  quite  sensitive  to  the  total 
kill  probaoility,  thus,  illustrating  the  importance  of  the  effects  of  the 
many  of tense/defense  parameters  encountered  in  combined  arms  combat  sit- 
uations. 

h.  Comparison  Between  ResuHs  from  the  Analytk  and  a Simulation  Mo- 
del . A comparison  was  made  between  the  results  of  the  analytic  model  and 
a firepower  simulation  model  which  involved  engagements  between  many  di- 
visions on  three  fronts.  There  was  a large  variation  in  battle  activity 
from  front  to  front  and  division  to  division  in  the  simulation  model.  As 
a result,  divisions  were  selected  which  had  the  same  losses  as  the  ana- 
lytic model  in  an  initial  12  hour  period.  Figure  12  shows  that  the  ana- 
lytic attrition  curve  has  approximately  the  same  shape  as  the  attrition 
curve  from  the  simulation  model  for  the  first  b to  b days  after  the  in- 
itial 12  hour  interval . 

3.  OBSERVATIONS  AND  SUMMARY.  A system  of  analytic  equations  is  pre- 
sented and  applied  to  division  combat  between  opposing  forces.  Sensi- 
tivities to  many  input  variables  are  presented  and  shown  to  conform  to 
physical  expectations.  The  attrition  curves  are  shown  to  have  approxi- 
mately the  same  shape  as  those  obtained  from  a simulation  model. 
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particular,  1 would  like  to  acknowledge  the  contributions  of  COL  K.  H. 
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(^)  WEAPON  6 HAS  ALREADY  BEEN  KILLED  AND  CAN  HAVE  NO  SUBSEQUENT  EF'=ECT. 
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DETER.^'iINATION  OF  LOSS  COEFFICIENT  FOR  ATTRITION  EQUATION 
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FIGURE  8.  TYPES  M&M'  VS  N&N' 
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FIGURE  9. 


PKPTF  (N) 
PHPTT  (N) 


FIGURE  IQ. 

EFFECT  OF  LINE  OF  SIGHT.  DETECTION  AND  ACQUISITION  PROBABILITIES  ON  ATTRITION 
K (NH)  .7  SINGLE  SHOT  KILL  PROBABILITY 
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TION  IN  DETECTION  (4)  PLUS  DEGRADATION  IN  ACQUISITION  (5)  ONLY  WPN  N DEGRADED  NOW 
(6)  LINE  OF  SIGHT  FOR  M & M'  NOW  DEGRADED  (7)  PLUS  DEGRADATION  IN  DETECTION  (8)  PLUS 
DEGRADATION  IN  ACQUIS.  PROB. 


FIGURE  11. 

FRACTION  SURVIVING  VS.  PR03ABI 


pkptt(n),  probability  of  KI 


FIGURE  12.  COr^PARISON  BETWEEN  ANALYTICAL  AND  SIMULATION  ATTRITION  CURVES 
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OP  the  NUKEER  of  SHOTS  THAT  ARRIVE  FPXV^  n"  TO 
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FIGURE  15. 


DENOTES  THAT  m WEAPON  HAS  PREVIOUSLY  BEEN  KILLED 
AND  CAN'T  FIRE. 


Fr:URE  16. 

UNITY  - NO  EPFECT  ON  PROBABILITY,  SINCE  THE  m WEAPON 
WAS  ALREADY  KILLED  BEFORE  IT  WAS  SCHEDULED  TO  FIRE  OR 
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ABSTRACTS  SUBMITTED  BUT  NOT  PRESENTED 

Title:  AnAnaiysi'  of  Military  Traffic  Management  Coninand  (MTMC) 
Participation  in  the  REFORGER  76_^ercije 
Authors;  MAJ  John  M.  Burbidge  and  CPT  Raymond  A.  Schaible,  Military 
Traffic  Management  Command 

Abstract;  The  annual  exercise.  Return  of  Forces  to  Germany  (REFORGER), 
has  been  for  the  last  decade  the  focal  point  of  the  United  States'  reitera- 
tion of  its  commitment  to  the  defense  of  Europe.  In  past  years,  the  emphasis 
has  been  on  the  airlifting  of  troops  to  prepositioned  equipment  in  Germany 
for  participation  in  the  annual  NATO  exercises.  In  1976,  however,  the 
REFORGER  Army  division,  the  101st  Airborne  Division  (Air  Assault),  was 
deployed  with  its  organic  equipment.  The  exercise  involved  the  simultaneous 
movement  of  personnel  by  air  and  equipment  by  sea.  The  Military  Traffic 
Management  Coiiiiiand  developed  and  tested  the  conceptual  plans  for  the  de- 
ployment as  well  as  coordinating  the  surface  movement  of  unit  equipment  from 
CONUS  home  stations  to  Europe  and  return.  Transportation  planners  employed 
a total  systems  approach  in  bringing  together  the  transportation  requirements 
for  the  exercise  and  optimizing  strategic  air  and  sealift  assets  in  the 
deployment  of  the  REFORGER  division.  The  proposed  paper  analyzes  MTMC 
participation  in  the  REFORGER  76  Exercise  and  evaluates  the  Defense  Trans- 
portation System's  capability  to  support  the  transportation  of  the  equipment 
of  an  airmobile  division,  including  over  300  helicopters,  from  a CONUS  origin 
to  a potential  combat  employment  destination  overseas. 

Title:  The  E_^e^t  of  the  Operational  Readiness  of  the^  Float  on  the 
Operational  Readiness  of  the  Entire  Fleet 
Author:  Dr.  Frank  Fox,  US  Army  Aviation  Systems  Command 
Abstract : The  operational  readiness  (OR)  rate  of  a fleet  of  aircraft  is 
calculated  by  dividing  the  hours  in  commission  for  the  fleet  by  the  hours 
on  hand  for  the  fleet  and  multiplying  by  100  to  convert  to  a percentage. 

The  OR  calculation  includes  both  the  aircraft  assigned  to  the  unit  and  the 
float  aircraft  which  serve  the  unit.  When  an  aircraft  assigned  to  a unit 
needs  extended  maintenance,  it  is  replaced  in  the  fleet  by  exchanging  it 
for  a float  aircraft  which  is  operationally  ready.  Hence  the  float  has 
given  up  an  operationally  ready  aircraft  for  one  which  may  be  out  of  service 
for  a lengthy  period.  This  process  of  continually  giving  up  operationally 
ready  aircraft  for  non-operational ly  ready  aircraft  causes  tn?  OR  rate  of 
the  float  to  be  much  lower  than  that  of  the  fleet  as  a whole.  Therefore,  the 
inclusion  of  the  float  aircraft  in  the  calculation  of  the  OR  rate  for  the 
entire  fleet  decreases  the  OR  rate  from  what  it  would  otherwise  be  it  the 
float  aircraft  were  not  included.  In  this  paper  some  useful  relationships 
between  the  OR  rates  for  the  fleet  as  a whole  and  its  flaat  are  developed 
and  illustrated  with  equations,  graphs,  and  tables.  For  example,  one 


equation  shows  the  decrease  in  the  OR  rate  caused  by  including  the  float 
aircraft  in  the  calculation.  The  magnitudes  of  the  effects  illustrated  by 
these  results  depend,  of  course,  on  the  values  of  the  parameters  involved. 
However  it  is  clear  from  the  range  of  possible  values  for  the  parameters 
that  the  OR  of  the  float  can  decrease  the  OR  of  the  whole  fleet  by  a few 
percentage  points.  This  is  significant  amount,  since  when  the  OR  rate  is 
below  its  goal  it  is  often  by  only  a few  percentage  points. 

Title:  Logistics  Enhancement  Handbook 

Author:  COL  Aaron  L.  Lilley,  Jr. , Headquarters,  First  US  Army 
Aj^strac^:  The  handbook  entitled  Logistics  Enhancement  is  intended  to  aid 
the  Active  and  Reserve  Components  in  obtaining  an  increased  level  of 
logistical  efficiency.  Included  in  the  handbook  are  chapters  on  Property 
Book,  Supply,  Maintenance,  and  Personnel  and  Training.  Since  the  Property 
Book  Officer  is  the  key  to  a successful  unit  supply  operation.  Chapter  2 
outlines  the  necessary  steps  to  be  taken  in  order  to  achieve  the  elusive 
goal  of  having  on  hand  10055  of  all  authorized  property.  The  attainment  of 
a responsive  supply  system  is  crucial  to  the  proper  functioning  of  the  entire 
organization.  Accordingly,  nearly  half  of  the  handbook  is  devoted  to  the 
supply  operation.  Maintenance  is  inexorably  linked  to  supply.  A good  mainte- 
nance system  will  result  in  the  achievement  of  fully  combat  ready  units. 
Personnel  and  training  actions  should  be  wel 1 -plann\?d  and  prudently  executed 
to  insure  that  the  path  to  optimum  logistical  posture  is  a smooth  one.  The 
Logistics  Enhancement  handbook  is  currently  being  reviewed  by  MUSARC  DCSLOGs. 
Early  indications  are  that  it  is  being  well-received. 

T i^l^:  PERT  as  a Data  Base 

Author:  Mr.  Michael  E.  Neyer,  US  Army  Tank-Automotive  Materiel  Readiness 
Command 

Abstract:  PERT  has  seemingly  come  full  cycle.  Managers  are  extremely 
interested  in  actual  schedules  and  projects  as  well  as  in  probabilities  of 
accomplishment.  Previous  drawbacks  of  PERT  were  a lack  of  memory  and  slow 
updating.  This  discussion  will  show  how  to  overcome  these  drawbacks  by  use 
of  PERT  as  a management  data  base.  The  data  base  design  offers  the  advantages 
of  real  time  computer  applications,  the  ability  of  a manager  to  include 
various  sub-networks  in  the  entire  PERT  network,  and  the  ability  to  monitor 
any  sub-networks  separately. 

Title:  Role  of  the  Operations  Research  Analyst  in  a Product/Project  Manager's 
Office  (PMO) 

Author:  Mr.  Michael  E.  Neyer,  US  Army  Tank-Automotive  Materiel  Readiness 
Command 

A^bs_^ract:  This  discussion  will  cover  four  topics.  The  first  topic  covered 
will  be  how  and  when  a PMO  should  determine  that  the  addition  of  an  OR  analyst 
to  the  staff  would  be  beneficial  to  the  office.  Secondly,  the  discussion 
will  cover  the  historical  projects  of  an  OR  analyst  in  the  office  of  the  PMO 
M880.  Next,  will  be  the  general  advantages  that  accrue  to  the  PMO  by  having 


an  OK  analyst  nn  Ins  statt.  ami  t hn  last  topii  will  i nvi'c  I lie  um'  nl  •!  I’MO 
assiiinmont  ton  larin'r  ilt'vnloj'iiu’nl  nl  OK  analysts. 

Titlt';  K('st'ai-(h  Analysis  or  fust  Analysis;  An  Army  Vit'wiminl 
Atitlior:  Of.  Itu'oOtxs'  Iryinil,  US  Army  Mattx'inl  Orvt'ln|)im'nt  ami  Krailim-ss 
('i^mmaml 

Atistrart:  Ihis  papi'r  pri'srnts  .1  rorporatr  lonk  .it  Ai  my  Ki’soiin  r An.ilysis 

prot'li'ins  im  lmlimi  the  OAKtU'M  I'rsourrr  M.in.uti'inrnt  Systi'iii.  Nrw  lonr.t'pts, 
primipli's,  .iml  tri'iuls  arr  prrsrnit'il  I rnm  a t.np  mamuii'im'nt  nviMvirw.  Str.i- 
tmiii;  appro.u  Ik’S  to  rrsouri  t'  .in.ilysis  pri'ltU'ins  .\rr  nxpl.i  inml.  Mi't  hmlolmi  ii's 
siirh  .IS  rrvit'w  ami  roiiin.iml  assossnu'iit  nl  prmir.ims,  i nmm.iiul  m.in.uii>mnnt  rnvii'w 
.ind  .in.ilysis,  mn.isurns  nf  rnsr.inh  nl  t m t i vniu'ss , over. ill  pnrtnrm.imn  imli- 
i.itnr  rnvinw  .iml  .in.ilysis,  prnilmtivitv  I rnml  nv.i  1 ii.i  I inn , .iml  milnstniin 
tm.  III!  ii|uns  .irn  ilisiiissml  with  nmph.isis  nn  innnv.it  ivn  m.in.ujnmnnt  .ipprn.u  tins 
ami  .ippl  ii'.it  inns . Ihn  rnsoiiri  n m.in.ninmnnt  syslt'iii  im  lmlns  t tin  snt  nf 
il i sn i [)1  inns  .uul  prm  inliirns  t'm  nmp.issim)  t tin  priu  nss  invnlvn.l  in  pl.innimi; 
nstahl  isliimi  nnals,  nstimatiiu)  rmiiiirml  rnsniin  ns;  assinnimi  nh.im  t ivns 
ami  t imn- ('liasml  tasks  In  npnr.it  iiu)  .uiiMu  ins;  issuimi  ('rn.iram  pl.imiiiui  aiul 
hmliintimi  ilirnnt  ivns;  nv.i  1 ii.it  i lU)  .\ml  .in.ily/imi  pnrtnrm.imn  .iml  rnsniirnn 
lit  i 1 i.’.it  inn;  .iml  rnndnrimi  m.in.uinr i.i  1 .ind  npt'r.it  inii.i  1 dm  isini  s.  lliis  p.ipnr 
disnussns  tinw  rt'soiirnn  .in.ilysis  rnsnlts  in  insl  rndin  I inns  .nul  »nsl  I'llnn- 
t ivn  wnapnn  systi'iiis,  .iml  hnw  nnw  rnsniirnn  m.in.ninmnnt  t nntin iipins  imprnvi'  t lii' 
m.in.ninmnnt  prmnssi's  nf  pl.imiimi,  nv.i  I mil  inn  .iml  nnnirnl. 

lilln:  Cnst,  nt  lnrmin.il  imj  fnntr.nls  study  (kOKOb  1) 

Aiittinr;  Mr.  .1.  S.  but  li'rt  inld.  O'.  Army  Avi.it  inn  Systt'ms  I'nniii.ind 
Ahsir.u  l:  1 hi'  t'nsf  nl  Inrmin.il  imi  ('niitrants  Study  (r.OU'OS)  was  inili.iti'd 
hni.iusn  nf  rnm  nrn  .is  tn  whnilii'r  t hn  prmin'ss  paymnnis  hnimi  m.nh'  hy  Inmiipi 
milit.iry  puis  li.isnrs  nl  Army  lypn  .liisr.itt  wnit'  .ulm)ii.itn  tn  di'tr.iy  Ihn  nnsi 
nf  inntr.u  t tnrmin.it  inn.  A snt  nl  ti'niiin.it  inn  li.il'ilitv  l.ihlns  h.ul  hnnn 
dnvnlopnd  hy  t tin  Air  I nrnn  .iml  wni  i'  hnimi  mnnnmu'iulnd  Inr  iisn  I'v  OAKl  OM. 

1 linrn  w.is  dniiht , linwi'vnr,  rm|.irdimi  t tu'  .idmiii.uy  nt  t linsn  l.iIWi'.  fnr  tnri'i.in 
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In  I tin  nvnnt  tlin  Air  I nn  n inlnriiMtinn  was  tnuiul  In  hn  in.ulni|u.it  n , 
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llin  .issumpl  inns  tnrmimi  tlin  h.n.is  tnr  I tin  sludv  wnrn  .n-  Inllnw-.: 
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of  nosts;  tills  rnpnrt  imi  I.hi  i'.  .r.sumnd  tn  imrn.isn  linn.irlv  until  it 
rn.udins  ‘>0  d.iys  midway  tlirnuiili  tlin  nnntr.iit  .iml  tn  rnm.iin  inir.tant,  I hnrn 
.if  tnr,  for  I tin  rnm.iin  imi  t>«ilt  nl  thn  inntr.ut. 
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3.  That  a "normal " contract  is  closed  out  90  days  after  the  last 
del ivery  is  made. 

4.  That  cost  incurred  is  a continuous  function,  when  in  reality  it 
is  discrete  and  discontinuous. 

5.  That  the  small  number  of  contracts  available  for  analysis  is 
sufficient  to  provide  a basis  for  sound  generalizations  about  future  cases. 

The  following  conditions  constrained  the  study: 

1.  A relatively  small  number  of  "clean  contracts"  on  which  to  perform 
the  analysis. 

2.  Lack  of  uniformity  in  the  incurrence  and  reporting  of  costs. 

The  study  resulted  in  the  average  or  "equally  likely"  cost  incurred  curve 
for  Anny  Aviation. 

The  conclusions  from  the  study  were  that: 

1.  The  AVSCOM  average  or  "equally  likely"  curve  of  the  cost  incurred 
fulfills  the  current  DARCOM  definition  for  a termination  liability  curve. 

2.  A greater  number  of  cases  must  be  analyzed  in  order  to  render  the 
analysis  more  statistical ly  sound. 

The  foregoing  conclusions  gave  rise  to  the  following  reconiiiendations : 

1.  That  the  AVSCOM  average  or  "equally  likely"  curve  be  adopted  as 
the  basis  for  reckoning  the  payments  to  be  made  by  FMS  customers  who  pur- 
chase Army  aircraft. 

2.  That  a computer  system  be  developed  for  using  future  contractual 
reporting  information  to  modify  the  AVSCOM  curve  as  may  be  required  to 
make  it  more  descriptive. 

Title:  Technology  Forecasting  at  the  Bench  Level 
Author:  Or.  Norman  Slagg,  US  Army  Armament  Research  and  Development 
CoiiBDand 

Abstract:  It  has  been  pointed  out  that  technolocjy  forecasting  is  a tool 
that  can  lead  us  from  the  logical  future  based  on  current  knowledge  to  a 
"willed"  future.  This  paper  is  concerned  with  the  application,  through 
forecasting,  of  our  most  important  resource,  the  accumulated  scientific 
engineering  knowledge,  to  the  resolution  of  future  military  problems.  Prior 
to  1900  science  and  technology  developed  independent  of  each  other.  The 
steam  engine  was  developed  prior  to  the  formulation  of  theniiodynamics . Now 
there  is  much  closer  coupling  and  this  situation  must  he  recognized  as  we 
look  ahead.  Technology  forecasting  has  been  used  by  the  three  Services  in 
broad  planning.  Unfortunately  it's  carried  out  at  a level  somewhat  distant 
from  the  research  and  development  laboratories  and  divisions  whore  Ltie  ma.'O" 
technical  competence  exists.  In  this  paper  a general  discussion  is  pre- 
sented of  the  potential  benefits  from  an  aggressively  pursued  technology 
program  at  the  bench  level  to  programs  on  bombs,  shaped  charges,  and 


electro-optical  devices.  This  discussion  will  include  the  effect  of  fore- 
casting on  the  coupling  between  fundamental  science  and  military  programs, 
on  innovations,  and  the  time  between  innovation  and  realization.  Methods 
are  suggested  on  how  forecasting  can  be  simply  included  in  current  R8i0 
organizations , 

Title:  Reducing  Unsought  Consequences  in  Automatic  Data  Processing 
Equipment  Procurement 

Authqr^:  ILT  Andrew  C.  Rucks,  US  Army  Concepts  Analysis  Agency 
Abstract:  The  interplay  of  competing  intra-agency  and  inter-agency  objec- 
tives for  automatic  data  processing  equipment  (ADPE)  procurement  create  an 
apparent  conundrum.  An  Army  agency  attempting  to  acquire  new  or  replacement 
ADPE  is  primarily  concerned  with  optimizing  system  performance  relative  to 
its  workload.  Competing  with  this  objective  are  inter-agency  objectives 
(originating  in  various  Army  and  non-Army  governmental  agencies  that 
regulate  ADPE  procurement)  which  include:  allocating  scarce  fiscal  resources, 
assuring  coordination  among  all  interested  governmental  bodies,  assuring 
technical  quality  in  a proposed  system,  and  assuring  competition  among  po- 
tential suppliers  of  ADPE  or  ADP  services.  The  stimuli  for  these  inter-agency 
objectives  are  trends  in  the  government's  overall  procurement  policy.  Failure 
to  respond  to  changes  in  policy  diminishes  an  agency's  contribution  to  the 
achievement  of  inter-agency  objectives  and  can  lead  to  unsought  consequences 
in  the  form  of  delays,  degraded  system  performance  and  negative  budget 
variances.  The  apparent  conundrum  created  by  the  aforementioned  competing 
objectives  can  be  transformed  into  a soluble  problem  by  careful  and  purposeful 
planning  and  plan  execution.  This  paper  will  explore  plan  formulation  and 
execution  by  the  US  Aniiy  Concepts  Analysis  Agency  in  its  efforts  to  acquire 
replacement  ADPE.  The  paper  will  cover  the  following  topics: 

1.  Steps  in  the  planning  process. 

1.  Elements  of  the  ADPE  acquisition  process. 

3.  The  application  of  activity/event  network  analysis  to  ADPF 
acquisition  planning. 

4.  Workload  analysis. 

5.  Preparation  of  a comparative. economic  analysis. 

Title:  Cost  Effectiveness  of  the  Armor  Force 

Au_^hor:  Mr.  Hung  Wang,  US  Army  Concepts  Analysis  Agency 

Abstract:  This  paper  presents  a method  of  developing  the  combat  effectiveness 
per  dollar  relationships  of  armor  forces.  The  work  was  performed  in  support 
of  the  Tank  Force  Management  Group.  Combat  effectiveness  was  estimated  by 
use  of  a methodology  which  quantifies  the  contribution  of  firepower,  mobility, 
survivability,  etc,  and  then  expresses  their  composite  value  as  a numerical 
score.  The  cost  associated  with  the  armor  forces  was  determined  through 
a multi-step  process;  a)  assuming  the  Army  is  comprised  of  economic  sectors; 
b)  determining  what  percentage  of  each  sector's  budget  supports  the  armor 


force;  and  c)  calculating,  through  input-output  analysis,  the  total  budget 
required  to  sustain  a given  annor  force.  The  costs  and  combat  effectiveness 
scores  were  input  into  a series  of  computer  programs  which  yielded  combat 
effect! veness-per-dol lar  ratios.  In  essence,  the  programs  distributed  the 
effectiveness  measure  among  the  sectors  according  to  a series  of  rules;  and 
then  divided  the  scores  by  their  associated  budget.  Several  alternatives 
were  analyzed  and  showed  that  increased  funding  of  the  annor  forces  result 
in  increased  Army  combat  capability. 

Title:  Supporting  the  Procurement  Process  Through  the  Use  of  An  Analytical 

Cos  t Modfil 

Author:  Mr.  Harvey  .1.  Slovin,  US  Anny  Electronics  Coinnand 
Abstract;  The  Anny  Electronics  Coninand  has  been  using  an  analytical  cost 
model  to  estimate  costs  for  development  and  production  programs,  in  setting 
design  to  unit  cost  bogeys,  and  for  evaluating  the  cost  impact  of  design 
tradeoffs.  In  the  interest  of  better  utilizing  our  dwindling  resources,  and 
to  take  full  advantage  of  the  capabilities  ot  the  model,  application  of  the 
parametric  model  has  been  extended  to  include  supporting  the  procurement 
process.  New  applications  of  the  model  are  in  management  planning  for  short 
- and  long  - range  programs,  for  developing  independent  estimates  for  develop- 
ment and  production  contracts,  in  pinpointing  areas  of  concern  during  "should 
cost"  evaluations,  in  supporting  procurement  and  production  planning  in  areas 
of  lead  time  and  delivery  schedules,  and  in  assisting  in  the  source  selection 
process.  While  the  model  is  not  intended  to  completely  replace  traditional 
methods  of  performing  these  functions,  cost  model  assistance  in  the  procure- 
ment process  allows  the  better  utilization  of  resources,  completing  the  tasks 
faster,  and  with  more  confidence. 

Title:  Evasive  Targets  for  Tanks 

Author:  Mr.  Edward  C.  Christman,  US  Army  Materiel  Systems  Analysis  Activity 
Abstract:  The  Army's  requirements  documents  for  tanks  have  included  a hitting 
probability  requirement  for  constant  velocity  targets  but  not  for  accelerating 
targets.  This  omission  was  at  least  partly  due  to  lack  of  methodology.  It 
was  found  that  lead  computers  designed  to  meet  the  requirement  frequently 
performed  poorly  against  varying  velocity  targets  which  undoubtedly  occur 
more  frequently  than  constant  velocity  targets.  In  response  to  this  void, 
AMSAA  is  doing  a study  to  do  the  following: 

a.  Determine  the  nature  of  the  motion  of  tank  targets  (how  to  charac- 
terize and  categorize  target  motion),  determine  the  spectrum  of  the  categories 
to  be  encountered,  and  determine  the  frequency  of  occurrence  to  the  various 
categories  of  target  motion. 

b.  Develop  a new  model  for  estimating  probability  of  hitting  accelerating 
targets. 

c.  Use  a.  and  b.  to  study  design  .and  performance  tradeoffs  and  develop 
a draft  requirement  statement  concerning  accelerating  targets. 

AMSAA  will  present  the  content,  results  and  conclusions  of  this  study. 
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Title:  Long  Range  Artillery  Opportunities  and  Challenges 
Author:  Mr.  Charles  T.  Odom,  US  Army  Materiel  Systems  Analysis  Activity 
Abstract:  Measurement  of  the  benefits  to  be  gained  from  the  use  of  long 
range  artillery  is  dependent  upon  a number  of  factors.  The  method  of 
propulsion  for  the  projectile  will  have  an  effect  upon  the  delivery  accuracy 
and  the  weapon's  reliability.  Any  projectile  which  flies  an  unguided 
ballistic  trajectory  will  generally  have  large  errors  at  the  terminal  end 
of  long  range  trajectories  which  will  degrade  the  effectiveness  of  the 
projectiles.  Any  increase  in  muzzle  velocity  of  a cannon  weapon  required 
to  increase  its  range  will  generally  increase  the  forces  into  the  weapon 
thereby  degrading  its  reliability.  The  weight  of  ammunition  which  can  be 
supplied  to  an  artillery  unit  is  a constraint  which  must  be  considered.  The 
amount  of  ammunition  required  to  meet  a given  level  of  effectiveness  at 
long  range  is  much  greater  than  for  the  same  target  at  shorter  ranges.  Thus, 
either  the  attack  criteria  for  long  range  targets  must  be  lowered  to  prevent 
inordinate  expenditures  which  would  tend  to  degrade  the  units  shorter  range 
capability,  or  the  military  value  of  the  longer  range  target  must  be  suffi- 
ciently large  to  compensate  for  the  values  of  shorter  range  targets  which 
will  not  be  fired  because  of  the  lowered  amount  of  ammunition  available  to 
the  unit.  The  question  of  a long  range  artillery  capability  is  one  of 
both  system  design  and  operational  trade-offs  which  must  be  carefully  weighed 
and  considered  by  both  weapon  designers  and  by  the  tacticians. 

Title:  Fire  Control  Against  Evasive  Ground  Targets 
Author:  Mr.  S.  S.  Wolff,  US  Army  Ballistic  Research  Laboratory 
Abstract:  Upper  bounds  are  derived  on  the  performance  of  an  arbitrarily 
sophisticated  - but  non-clairvoyant  - "lead"  algorithm  working  from  manual 
tracking  inputs  against  a deliberately  evasive  target.  Such  bounds  are 
useful  in  assessing  the  utility  of  contemplated  modifications  to  current 
systems. 

Title:  Engineer  Estimate--V  (US)  Corps 

Author:  Mr.  Lyle  G.  Suprise,  Engineer  Studies  Group  (ESG) 

Abstract:  This  paper  will  present  the  methodology  and  unclassified  results 
of  an  effort  sponsored  by  HQ  V Corps.  The  requirement  for  the  study  grew 
out  of  the  revision  of  the  V Corps  General  Defense  Plan  to  reflect  FM  100-5 
doctrine,  the  target  servicing  technique,  and  the  active  defense.  An 
engineer  estimate  is  the  result  of  solving  a specially  defined  resource 
allocation  problem.  Limited  engineer  and  related  resources  are  allocated 
among  the  possible  Corps  area  engineer  tasks  to  promote  assured  target 
servicing  by  the  active  defense  subject  to  the  requirements  for  overall 
economy  of  manpower  and  materiel.  The  study  focuses  on  the  feasibility  and 
effectiveness  of  the  obstacle/barrier  plans  and  ways  that  they  can  be 
improved  as  well  as  Corps-wide  engineer  requirements.  The  relation  of 
engineer  work  to  combined  arms  effectiveness  is  addressed.  Engineer  tasks 
are  identified  in  the  functional  areas  of  mobility,  survivability, 
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countennobil ity,  and  general  engineer  support  for  the  covering  force  area, 
main  battle  area,  division/brigade  rear.  Corps  area,  and  the  Corps  area  of 
interest  in  the  forward  COMMZ.  Important  considerations  in  the  analysis 
are  the  trade-offs  that  can/must  be  made  within  the  engineer  system  and 
trade-offs  between  engineer  and  non-engineer  tasks.  In  sum,  the  paper  will 
provide  a case  example  of  applied  combat  engineering  in  today’s  Army. 

Title:  The  Value  of  Information  in  Combat  Decision  Making 
Authors:  COL  Allen  F.  Grum,  MAJ  David  R.  E.  Hale  and  CRT  Terry  A.  Bresnick, 
US  Military  Acadany 

Abstract:  The  Lanchester  model  of  combat  has  generally  been  used  with 
detenninistic  values  of  initial  force  strengths.  In  reality  these  are 
probabilistic  parameters  that  can  be  described  by  probability  distributions. 
Techniques  of  evaluating  the  worth  of  perfect  information  on  force  strengths 
have  been  investigated  in  an  earlier  study.  This  paper  discusses  extensions 
of  this  methodology  using  concepts  developed  in  Decision  Analysis. 

Title:  : A System  for  Individual  Training  Accountability 

Authors:  Dr.  Ward  Harris  and  MAJ  Benjamin  Whitehouse,  US  Army  Training 
Support  Center 

Abstract:  With  the  implementation  of  the  Skill  Qualification  Test  (SQT), 
the  Army  has  launched  a new  system  for  evaluating  the  job  competence  of 
soldiers.  The  new  system  will  provide  training  managers  at  all  levels 
information  regarding  specific  tasks  that  individual  soldiers  can  and  cannot 
do.  Training  managers  can  then  focus  training  efforts  and  resources  on  tasks 
and  soldiers  that  need  it  the  most.  There  are  many  players  in  the  SQT,  and 
each  has  specific  responsibilities  in  achieving  the  purpose  of  SQT:  to 
improve  the  combat  effectiveness  of  the  Army  by  getting  soldiers  to  do  their 
jobs  better.  This  presentation  deals  with  the  SQT  participants,  their 
responsibilities  and  the  individual  training  accountability  system  that 
provides  feedback  for  better  individual  training. 

Individuals.  Every  member  of  the  Army  has  a responsibility  related  to  in- 
dividual training.  Specifically,  each  soldier  is  personally  responsible  for 
attaining  and  maintaining  proficiency  in  the  critical  tasks  that  define  his 
job.  To  insure  that  a soldier  knows  what  is  expected  of  him,  the  Army  issues 
a Soldier's  Manual  to  every  enlisted  soldier  for  his  current  and  next  higher 
skill  level.  This  manual  lists  critical  tasks  by  number  and  describes  what 
the  soldier  must  do  under  what  conditions  and  how  well  he  must  do  it.  In 
addition,  relevant  references  are  given  which  amplify  the  task,  its  con- 
ditions, or  standards.  These  related  training  materials  include  TEC,  corre- 
spondence courses,  literature  and  special  training  packages.  To  focus  the 
soldiers  efforts  prior  to  taking  the  SQT,  a notice  is  sent  two  months  prior 
to  the  test  period  indicating  precisely  which  tasks  will  be  tested  and  how 
they  will  be  tested  to  include  sample  questions.  Whether  the  soldier  meets 
his  responsibility  for  individual  proficiency  or  not  is  measured  to  a large 
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degree  by  the  SQT.  The  Individual  Soldiers  Report  (ISR)  provides  an 
evaluation  of  the  soldiers  job  proficiency  indicating  tasks  failed.  Ulti- 
mately the  burden  is  on  the  individual  to  maintain  job  proficiency  using 
existing  training  materials. 

Training  Managers.  The  training  manager  has  responsibility  for  scheduling 
of  time,  facilities,  equipment  and  other  resources  in  support  of  individual 
training.  If  the  soldier  is  to  meet  the  job  standards  of  his  soldiers  manual, 
then  the  commander  must  provide  time,  assistance  and  access  to  the  refe*'pnced 
training  materials.  To  assist  the  training  manager,  the  Commander's  Manual 
provides  task  identification  and  where  the  task  should  be  taught  and  rein- 
forced. The  first  line  trainer  (sqd  Idr,  etc.)  uses  a job  book,  which  gives 
the  status  of  each  soldier  by  job  task,  to  conduct  concurrent,  on  the  job 
evaluation  of  soldier  proficiency.  The  effectiveness  of  commanders  and 
supervisors,  in  context  with  other  relevant  factors,  as  trainers  is  accounted 
for  in  the  SQT  summary  reports  which  are  given  to  coniiianders  at  all  levels. 

Training  Developers.  The  base  for  individual  proficiency  is  the  job  and 
task  analysis  which  builds  the  Soldier's  Manual  and  the  task  related  training 
materials.  The  training  developer  integrates  doctrine,  infonnation,  pro- 
cedures and  all  aspects  of  job  perfoniiance  into  supporting  training  materials 
for  use  by  the  individual  in  achieving  and  maintaining  hisjob  proficiency. 

The  quality  of  these  training  products,  in  the  context  of  other  relevant 
factors,  are  measured  in  the  performance  of  the  soldiers  in  the  tasks  being 
trained  in  these  products.  The  school  commandant  is  accountable  for  the 
efficiency  and  effectiveness  of  the  training  systems  his  school  creates  for 
the  specialities  and  units  for  which  he  is  proponent. 

Training  Program  Managers.  For  those  delivery  systems  which  are  centrally 
managed  such  as  TEC,  ACCP,  Annywide  Training  Literature,  and  Training  Devices, 
there  is  a responsibility  to  the  individual  training  system  for  timely  and 
effective  delivery  of  the  training  materials  developed  in  the  schools.  The 
precision  of  the  SQT  will  allow  for  examination  of  each  of  these  products  and 
their  contribution  to  the  soldiers  ability  to  do  his  job.  Each  program 
manager  is  accountable,  in  the  context  of  other  relevant  factors,  as  to 
whether  his  product  achieves  its  objectives. 

SQT  Accountability.  Lastly,  the  SQT  must  be  a fair  and  relevant  performance 
oriented,  criterion  referenced  test.  The  SQT  uses  formative  and  summative 
methods  of  test  design  and  review.  However,  the  final  judges  are  the  soldiers 
and  commanders  who  use  the  SQT  to  achieve  and  maintain  unit  readiness. 

The  SQT  Training  Accountability  System  is  completely  interactive  in  that 
each  variable  must  be  well  defined  and  specifically  documented  in  deter- 
mining where  the  system  is  flawed  when  a soldier  cannot  meet  the  standards 
of  his  job.  The  SQT  is  an  evolutionary  evaluation  tool  to  achieve  and 
maintain  unit  readiness. 
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Title:  WSTEA  - An  Analytical  Approach 

Authors:  Major  Albert  J.  Erickson  and  Mr.  James  P.  Hamill,  US  Army  Armor 
School 

Abstract:  The  paper  will  describe  an  approach  developed  by  the  USAARMS 
for  conducting  a Weapons  System  Training  Effectiveness  Analysis  ^WSTEA). 
Included  will  be  the  methodology  and  analytical  techniques  used  to: 

1.  Conduct  a complete  front  end  analysis  to  include  equipment, 
personnel  and  intended  use. 

2.  Obtain  data  on  the  performance  of  individuals  and  units  using  the 
current  training  program. 

3.  Analyze  the  data  to  determine  the  effectiveness  of  the  program. 

4.  Determine  whether  there  are  modifications  which  should  be  made  to 
the  program  and  determine  whether  the  modifications  should  be  cost-effective. 

5.  Develop  the  cost-effective  modifications  in  detail. 

6.  Test  the  modifications  to  determine  whether  they  accomplish  their 
objectives. 

7.  Integrate  the  proven  modifications  into  the  existing  program. 

8.  Implement  the  modified  program. 

Title:  A Performance  Risk  Analysis 

Authors:  Mr.  Jose  Antunes,  Mr.  Gerald  Klopp,  Mr,  James  O'Brien,  and 
MAJ  K.  Mark  Woodbury,  US  Army  Logistics  Management  Center 
Abstract:  Risk  analysis  is  a systematic  process  to  evaluate  alternative 
research  and  development  projects.  The  areas  analyzed  in  a risk  analysis 
include  the  triad  of  cost,  schedule,  and  performance.  Cost  and  Schedule 
were  first  addressed  in  the  1950's  by  CPM  and  PERT;  since  the  late  1960's 
more  sophisticated  computer  simulations  like  RISCA,  SOLVNET,  and  VERT 
provide  ample  means  to  focus  on  the  problem  areas  of  cost  and  schedule 
risk.  This  paper  discusses  a computer  simulation  process  to  analyze  risk 
associated  with  performance.  The  risks  and  uncertainties  in  various 
performance  parameters  are  evaluated  as  probabilities  and  probability  dis- 
tributions. Via  Monte  Carlo  simulation,  the  interrelationships  among  the 
various  performances  parameters  are  quantified.  Their  effect  on  achieving 
an  assigned  level  of  performance  can  thus  be  measured.  The  objective  of 
this  article  is  to  demonstrate  a technique  to  analyze  performance  risk  or 
uncertainty.  To  achieve  this  objective,  parametric  equations  which  describe 
the  relationship  among  design,  operational,  and  environmental  variables  of 
a helicopter  system  will  be  presented.  Certain  of  these  variables  will  be 
described  in  terms  of  subjective  distributions  to  indicate  the  measure  of 
uncertainty  in  particular  variables.  The  conclusions  of  the  analysis  demon- 
strate an  approach  to  address  performance  risk  analysis.  Finally,  the 
performance  risk  analysis  is  related  and  analyzed  in  conjunction  with 
schedule  and  cost  risk  analysis  for  the  helicopter  system. 


1160 


Tjtle:  The  T- COR  Model  and  its  Appljcatimi^ 

Author:  Mr.  Michal  Mruz,  The  BDM  Corporation 

Abstract:  T-COR  is  a theater-level  combat  model  being  developed  for  the 
Defense  Nuclear  Agency.  The  model  features  a Simulation  Control  Software 
(SCS)  package,  dynamic  storage  allocation,  a mixed  event/time-stepping 
capability,  and  a multi-granular  hexagonal  coordinate  system,  all  of  which 
serve  as  tools  to  be  used  by  the  modeler/analyst  to  develop  very  powerful 
and  flexible  simulation  models.  The  modeling  routines  in  T-COR  use  a 
"player-centered,"  as  opposed  to  "process-centered"  approach,  and  contain 
routines  which  treat  perceptions  of  reality  by  the  various  units  played 
in  the  game.  This  allows  T-COR  to  model  the  value  of  infoniiation  to  the 
commander,  and  the  effects  of  distorted  perceptions  on  the  outcome  of  the 
conflict.  T-COR  has  undergone  a preliminary  development  phase,  and  at 
present  the  modeling  routines  contain  only  a low  level  of  detail.  During 
the  second  phase,  which  continues  through  this  sunnier,  the  modeling  will 
be  developed  to  a level  of  detail  sufficient  to  use  T-COR  in  a study  effort 
later  this  year.  Input  and  output  of  data  for  the  study  will  be  accomplished 
with  the  User-Oriented  Input  Language  (UOIL),  which  allows  the  analyst  to 
put  data  into  the  model  using  English-like  sentences  and  phrases,  and  to  get 
results  of  the  simulation  out  of  the  model  in  the  same  manner. 

TJjt l_e : Helicopter  Cargo  Systems  Effectiveness  An aly sis 
Authors : Mr.  Timothy  D.  Evans  and  Mr.  Jules  A.  Vichness,  US  Army  Aviation 
Systems  Command 

Abstract:  This  paper  presents  the  results  of  a project  to  evaluate  the 
effectiveness  of  proposed  alternative  helicopter  cargo  handling  systems. 
Mathematical  modeling  and  simulation  techniques  were  used  to  develop  the 
analysis  method  presented  here.  Factors  considered  in  the  evaluation  include 
combat  threat,  terrain  types,  and  weather  conditions.  Also  considered  were 
the  physical  constraints  of  the  cargo  system  itself,  such  as:  loading  and 
unloading  time,  number  of  sorties  required  per  ton  load,  reliability, 
maintainability,  and  availability,  and  effect  on  aircraft  vulnerability. 

The  analysis  provides  measures  of  life  cycle  cost,  operational  effectiveness, 
productivity  and  performance  in  both  combat  and  noncombat  situations.  The 
results  of  this  evaluation  are  used  to  assist  in  establishing  research 
priorities  in  terms  of  benefits  achieved,  costs  incurred,  and  risks  assumed. 

Title:  PERT  as,  a.  Management^  Tool  for  Impl ement i ng^  a Real i gnmen t Act i on 
Authors:  Mr.  A.  J.  Rymiszewski,  Mr.  Donald  S.  Case,  Mr.  Phillip  Powers  and 
Mr.  Kurt  Wussow,  US  Army  Tank-Automotive  Materiel  Readiness  Command 
Abstract:  This  paper  will  present  how  USATARCOM  responded  to  the  DA  request 
to  Implement  a realignment  action  for  the  TARCCM  Support  Activity,  Selfridge 
Air  National  Guard  Base,  Michigan.  Emphasis  will  be  placed  on  the  multi- 
disciplined  task  team  composition  and  their  use  of  OR/SA  techniques  to 
develop  an  implementation  milestone  schedule.  The  use  of  PERT  as  a manage- 
ment flow  diagram  to  define  as  well  as  control  the  required  interrelationships 
between  various  TARCOM  functional  directorates  with  OARCOM,  DA,  AAA,  DCAA 
and  SBA  will  be  highlighted. 
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Title:  Application  of  Dynamic  Mean  to  Demand  Forecasting 
Author:  Mr.  Daniel  Meng,  US  Army  Tank-Automotive  Materiel  Readiness  Command 
Abstract:  The  objective  of  this  study  is  to  find  practical  forecast 
techniques  other  than  the  moving  average  currently  employed  in  forecasting 
secondary  item  demand.  New  parameters  were  derived  through  the  dynamic 
mean  process.  The  resultant  forecast  was  compared  with  both  moving  average 
and  Kalman  filter  techniques  based  on  six  years  of  tank-automotive  repair 
parts  demand  histories.  Better  forecast  parameters  are  recommended. 

Title:  New  Management  Coordination  Tool:  Definition/Prioritization/ 
Management  (PPM)  Technique  ^ 

Author:  Mr.  V.  Berger,  US  Army  Aviation  Systems  Command 
Abstract:  This  paper  presents  a process  whereby  project  and  weapon  systems 
managers,  and  their  supporting  network  of  functional  managers  recognize  and 
prioritize  topics  of  mutual  interest.  The  process  is  designed  to  accommodate 
project  dynamics,  to  provide  a procedure  for  management  by  exception,  and 
to  generate  an  audit  trail  of  management  activities  in  complex  projects. 

The  DPM  technique  is  suitable  for  use  in  conjunction  with  DRA-guided  program 
management.  The  paper  provides  examples  of  DPM  technique  applications  in 
weapon  systems  management. 

Title:  MOEs  for  Division  Level  Models 

Author:  MAJ  John  H.  Shuford  and  CPT  Fredrick  H.  Knack,  US  Army  TRADOC 
Systems  Analysis  Activity 

Abstract:  High  level  excursions,  using  the  Division  Battle  Model  (DBM)  or 
a similar  game,  are  expected  to  become  more  important  in  the  performance  of 
future  Cost  and  Operational  Effectiveness  Analyses  (COEAs).  It  is  therefore 
necessary  that  a good  Measure  of  Effectiveness  (MOE)  for  use  with  these 
games  be  developed.  Certain  MOE,  such  as  the  force  exchange  ratio  or  other 
ratios,  have  become  accepted  as  providing  good  estimates  of  the  results  of 
high  resolution,  company/battalion  level  combat  simulations.  Efforts  have 
also  been  made  to  develop  analytical  weighting  systems  for  the  different 
weapons  in  order  to  compute  weighted  MOE.  Both  of  these  methods  have  been 
used  to  analyze  the  outcome  of  DBM,  a low  resolution,  division  level  war 
game,  but  neither  has  been  entirely  satisfactory.  It  is  hoped  that  this 
paper  will  stimulate  interest  and  further  investigation  into  the  analysis 
and  interpretation  of  combat  simulation  results. 


